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' ABSTRACT 
\ ' ■ . ' ' ' " ' 

Online searches^ of bibliographic data bases were conducted for 

scientists and technologists In one' academic and one Industrial set- 
ting. In order to determine the effect of this new technological 
development on its users' information style, and to determine how, ' 
how often, and' with what satisfaction online search services are 
used, records of use were maintained and ^users as well as nonusers 
of the online search service in the two environments were surveyed 
prior to the-start and at the conclusion of the first phase of the 
search. service. • * . 

In the first phase of the Project ^ free and mediated . (searched, 
by Informa^tion specialists) search service was provlde,d.* In the 
second phase, mediated search servlce^^at half' the computer connect 
and offline printing costs was provided. In the third phase, free, 
nan<-mediated (searches conducted by final xiser of Information) search 
service was provided.' - • 

No striking change in information style that held truel for both, 
settings could be Identified. Records of over 900 uses of online 
search service by almost 200 users*, are characterized by factors such 
' as 4-nf ormatlon sources used prior tt^ ""reqliesting online search service, 
amount of negotiation time required, number of non-retrieved relevant 
documents, and user satisfaction with currency , size, and utility of ' 
search output. ^ t ♦-ijP^* 
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• . _i ^ ; ^ ^ . ; 

INTRODUCTION • ' 

'■.■ ■»' / • ' ■ ' ... ■ ' 

• Online searching of bibliographic data bases .constitutes an Im- 

" * pdrtant new tool of the scientist and technologist and of , the librarian 

i concerned with meeting their information needs/ According to Martha 

\~, Williams in 1977, there' were 50 million bibliographic records searchabW 

- .online;"" about 29 million were to portions of the literature' of science and 

ip^chnology. Also, in 1911 ^ more'^han, two million onlinie searches were con- 

ducted. This represents a 40 pfercent increase over 1976^ Yet with "^11 

this activity in the field, relatively little is known about how ^nd for* 
.. ■ . > . ■ 

what purpose scientists and" technologists use online searches, their 

satisfaction with this ^new bibliographic service and what changes, if any? 

occur in the information. style of scientists and technologists when' online . 

' - ■ ' -. - • ■ '■. ' J " ' ' ' ■ . ' ■ , 

s> search service is introduced into the environment. . 

In 1976, a National Sciehcfe Foundation (NSF) study was initiated at 
. Florida State University (FSU) in an attempt to answer some of these ques- 
tions. The study was done in three phases. In Phase I, online search ser- 
^/^ ' vice was introduced in t^wo environments: at the Chemistry Department -of 



FSU, the academic environment, and at the Monsanto Textiles Company,* the . 

' - ■ ' ^ t 

^ *'f\ ■ . . ■ . ■ ■■ 

industrial environment. During this first phase, free search service was 

offeredMn both environments. In the second phase..^_orLtipe searches were 

/■ ' \ • ^^^^^ \ / .'^^^ 

provided in the academic\environment at half the cost of computef^ connect 

^ime and offline printing..^ ^'IrwJ'hases I and II, searches were performed by 

informatior^ specialists . Ila^ tl^^^lrd phage, embediied in the second 

•phase and again only' performed^^^F the academic environment J free online 

searches were offered on a self-service basis. The results of this work 

are given In this report.. . 
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';1. 'Martha Wllllgmi^, '.'1977 Data-Base and On-Llne Statistics," 
^uUetlft of the ASIS 4(2) (December, 1977): 21t'23. . . . 
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The primary oBjectfve of this study ^ was to determine the effect of 
exposiire to online search services ^on the overall Information st^le of 
academic and Industrial scientists and technologists, information style, 
broadly defined, consists o^ the wa^s InVfilch Individuals go about obtain- 
ing Information needed In their work. Theiihange In the Information environ- 
^^."^^^^s^he Introduction of a conveniently located, easy to ^use and"' (at • '* 
first) no--cost online search service. Other changes Introduced were in 

terms of cost (free versus half-cost) and in ways* of searching (mediated 

. p 

versus non-mediated). Changes in information style were monitored with the 
' aid of pre- and. post-test questionnaires, user interviews , recordS^TS^f 
online use*and user evaluation through feedback forms. > A secondary objec- 
tive was the gathering of data on the ways in which, online systems are 
used by scientists, as an aid In th6 pltonlng of online services. 

The main hypothesis of the study was' that exposure to online* search 
services which are acGessible; easy to use, and include relevant documents 
will change the information style of scientists, and technologist^. In / 
changes in ipformation style, three indications of^ change were 
examined: - . * \ / 

' . ' ^ , ^ ■ ' • ! . ■ ■ \ • ' ' ' 

: 1. The use of online searches for different types of Informa- ' ^ 
^ ■ ' ti6n needs. These needs include^current awareness, exhaus- 

.1 ' tive bibliographies^ specific facts, and "a few references on 

.- , '- 

.'^ ^ a subject;" 
2. The .decrease in use of other, previously used, information . 

sources, such as personal scanning of journals, or depending ' 
^ • upon input from calleagues. ♦ - 

\\ .3. fhe user's willingness, and ability to perform Ills owt> online 
. searches without going through an intermediary. 
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m aaaitloh to thehe indications, the characteristic^of i^nidustrial and 
academic users were compared, including early and^sybsequenV use, light, 
medium, and heavy use, and users in different ajge groups and\with dif- 

4 ■ ■ . .... 

f&rent jobs. - * 

Experimental Design 

In Phase I, prior to the introduction of online services, \ pre-treat- 
ment survey instrument was completed by all participants This Instru- 
ment was designed to assess personal background, work histories, i^thods 
of infomation search and preference, and prior experienc4 \kth online . - 
bibliographic searching.' Mediated' online search service was then intro- 
duced into the environment of the 'participants' and provided at no cost , 
Wij£h searchfes cpnducted on requjlsd by trained information specialists.' 
Following approximately one y^r ojf such service, another survejr instru- 
» ment was administered to assess impact an<J> changes in information style'. 
In addition to ^he questionnaire, selected. participants were interviewed. 
Records of use and user evaluations were also obtainjsd and analyzed. ' 

In Phases II and III, the study was limited to "the academic environ- 
ment, the number of potential users was increased, a^nd two significant-changes— 
user charges and non-mediated searching—were introduced at different 
times. - Records, of use, user evaluations, and user interviews were ob- 
tained during this phase.' . ' 

During the first phase, online searching service was provided at no 
Charge to a selected sample of participants at FSU and at Monsanto. This 
phase began at Monsanto in late March 1976 and lasted thirteen months, 
while at FSU, this phase began in late May 1976 and continued for eleven • 
months. At the end of this phase, the Monsanto technical library diclded " 
to take over full support for this service and provide it as a cegular 
part of its library information support. 



^Durlog the second phase, the search service was provided only at FS^ 
and offered to all nembets of the CheiJilstzy Department; ratheg^han.'a 
selected- sample . Also during this phase, an indirect? f ee d^^e-half the 
cost of cohiiect time and^offllne citations was charged to users to detet- 

mlne-theaniptoct of feps on the* nature and volume of search- red u^^ts. 

■ * • •': ■■ . ' - • , • ' ' y .''-i 

In Phaill III, no-cost self-searching was made available to" assess '/ 

thi attractiveness of ^'do-lt-yours'elf" searching. Phase II began In .mid- 
October 1977 and continued Until late May 1978. Phase HI lasted from , 
February 1 to. March 17, 1978. , V" ' 

Statistics for the phases areis'hown In Table 1. - , , / 

'^K'' .TabldW;: • V 



) 



Project Descriptive Statistics 
Phase I Free mediated searching, I 
FSU (May 28, 1976 - April 25, 1977) ' 

Sample population: 84 . - , 

Sample participants: 70 (respondents to pre-test) 

5P , (respondents to "post- test) 

- r ^ 

Service users: ^ 51 
Nori-users: f * 19 

Total search/^BT^^ / 353^ ^ 
Monsanto (March 25, 1976 - June 30, 1977) 
Sample population: 311 
. . Sample participants: 2&2 (respondents to pre- test) 

234 (coded post-tests) 
Sample uSers: „ 109 
Non-users : ' 153 
Searches: ♦ 345 
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■ .' . ' ■ ■ • ■ • , ^ ■ » . ■ • ? ' ■ 

- • . ..- Table 1 (continued) " ' 

'/ Phase ^tl Halfrcost mediated searching (Oct. 12, 1977 - May 31, 1978) 

/ Users: ' 57 - 

. '■ , • ■ 

* / ' - * .Graduate: 29 

- ^ Research Associate/ ^ 

, ' Post-doctoral: 10- 

; * - Faculty: 16 

' Othjlr: 2 

Searches: 155 

' . . Phase IIl^ Free non-mediated searching (Feb. 1, 1978 - Mar. 17, 1978) 

. Users: .44 

. Graduate: - ^ 
0 

Research Associate/ 
• PoS"t-docfeoral: 7 

Faculty: 2 

. Other: • . 4 ' ''^ 

' ■ Searches: 87 
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PROJECT ENVIRONMENT 
This study was conducted oyeE a two-year period at two locations, one 
academic, the other industrial. 'The academic environmenf^as the Chemistry 
^ Department of Florida State University, Tallahassee, Florida. FSU has 
an enrollment of about 21,000 students, with about 3,500 graduate students. ' 

. . • . ' ■■ / 

Doctoral programs are offered in 58 fields including chemistry, and the ^ 

chemistry Department is ranked nationally among the top twenty-five academic 

s . . . ... / 

chemistry departments, j 
. _ ... ' ■ ' % 

"The industrial environment was provided by- the Monsanto Textiles /fcom-- 

panpr (MTC) technical operations arPensacola, Florida, about 200 mi^es from 

Tallahassee. Monsanto has over 300 professional employees in its Research 

m / 

"^mi Development Department. The(2 Company's research, dttd development at Pensacola 
is directed towards the study of melt spun fibers procejsses' ^d properties, 
seeking ways to improve and modl|y^ylon, polyester and related melt spun 
polymers. V • - ' ' 

Florida State University 

The setting for acttial query negotiations with users and for the online 
terminal equipment differed between FSU and Monsanto. At FSU, the computer 
terminal and the irtftirma^on specialists were located in the Chemistry Re- 
search Building where most of th^ potential users worked'. The search service 
office was on the first floor near the main entrance, the elevators, the 
reading room and the departmental office so the location was highly convenient 
to all potential users. The reading room across the hall contained the 
printed volumes of Chemical Abstracts ^ the most frequently used reference 
source. 

Tlie search service office was used exclusively for the project service 

so there were no distractions by other activities. For most of the period ' 

/ 

of the experiment, the service operated twenty-five hours a week, typically 



(~ ^ , - ' • • • 

on a schedule of Monday, Tuesday, Wednesday 'and Friday from 9:3ff a.m. to ^ 
3:00 p.m. , and Thjirsday from 9:30 a.m. to 12:30 p.m. In the early menths 
of the service, anSffort was made to respond to requests for service in 
he evenings and on Saturdays but because of the low volume of use, this 
was not cost-effective and was ■discontTliiued. Duripg the first phase of the 
proj^t, service wap maintained during the briEiaks between academic quarters, 
miring th'e second phase, the service was closed during the winter (Christmas) 
bfteak, but was kept open during the spring break. 

The online 'terminal equipment used at FSU was, for. the first five weeks, 
a T-33 ten characters-per-se^ond impact printe.r. This was an interim unit 
as its slpw speed and noisy operation made it unstti table for (Continued winter- 
active searching. On July 9, 1976, the T-33 was replaced by an NCR ^60 
terminal, a thirty qharactersl^er-second thermal printer. This unit worked 
well throughout the first phase and its speed and quiet operation as compared 
With the T-33 emphasized the importance of these featureg in- interactive 
searching. With the start of the second phase in October 1977, the NCR was 

v.. 

replaced (bec^se of its higher rental) by a DECwriter II , also thirty' charac- 
ters-per-second , but Wit|i an impact printer. The impact noise was muffled ' 
and- the noise level was not noticeably higher than with the thefmal printer. 
There were no "downtimes" due. to terminal malfunction with "the faster units. 
Downtime was either the result of telephone system problems or difficulties 
at the host computei\ as will be noted latfer. 
Monsanto Textiles Company 

The online service at Monsanto was provided Initially at the Pensacola, 
Florida facility, using two of the members of the corporate library staff 
as searchers. In August 1976, the librarian from the Durham, North Carolina 
plant was also trained as a searcher. Users were located at these two 
facilities plus a few users at a plant in Decatur, Alabama. All searches 
from Decatur were sent by telephone or in writing to the Pensacola library 

■ r 



for searching. , . ; ' . ^ 'I 

The installatipn af Pensacola used a. Texas Instruments* model 745 portable 
•thermal terminal (30-characters-per-second) located d.n a small room in the 
• technical library. This room was also as-ed to store microfilm f ile»s^includ- 
ing Chemical Abstracts on microfilm) and a microfilm reader-printer. Most ' 
query negotiating was done in the Individual offices of the information 
specialists; the specialist and the user ^yould then- go to the terminal fdr' 
the actual search^^ Search service was available to users forty hours per 
week during the hours of ^:30 a.m. to -^.-OO p.m. Not all potential users . 
worked In the building that contained the library. 

At the Durham facility, a Texas Instruments model 735 terminal was 
used, with a thirty characters-per-second thermal printer. The terminal- 
was located in a library work room adjacent to the office of the librarian- 
searcher. She negotiated queries in her office and then v*ent with the user' 
to the terminal for the search. Search service was availablT\o users forty ' 
hours per week between 8:00 a.m. and 4:30 p.m. Chemical Abstracts on micro- 
film was also available at /his-, location. 



Differences in Test Environment 

\ — '. 

It 'can be seen that the primary differences between the test environments 
were the longer hours that the service was available at Monsanto, the 
availability of Chemical Abstracts on microfilm as well as print at Monsanto 
while only'ln^print at FSU, and the location of terminals within areas at 
Monsanto U9|d for>ther activities, i.e., the library, while the FSU offices 
were used exclusively for the search service. The academic calendar had some 
influence on usage at FSU which, of course, was not the c?se at Monsanto. 
The primary difference in terms of intermediaries was that at Monaanto the 
searchers were company employees already engaged in providing information seY- 
vices to the potential users, whereas at FSU, the intermediaries came from 
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outside the department/and were seen as providing ^nly the service of online 
searching. ' 
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• " • . REVIEW OF THE tiTERATURE 

A, review of the ' literature of information science and '.llbrarlanshi'p, 
prltaprUy since 1974, was ifi^de to determine what had been published bp,; five \. 
ttiplcs pertinent to the project: the effect of online searching -on the In- - 
form^tlonal style and productivity of users< user evaluations of , .and 
' sat la|act ion with, online searching; the use of intermediaries (librarians,. ' 
information specialiifrs) for o'hline searching; ,the. tralhlng f or oVlne 
searching of intermediaries and of final ^sers (self searching) r and the 
Impact of ug^r fees ort the u^e of online servLes'. The emphasis of Writings 
about online searching has been on various technical aspects of online 
systems.' Much less has been published on the topics of interest to tSis 

project. • \ f 

Information Style « re^ • • ^ 

-. -7- .-7^ . ?f ■ 

Rubensteln and his associates^ described information "style" as the 
tendency^to behave in a certain pattern in relation to information seeking and 
use, and this is the meaning as ^used i'n this report. . In their study, RuHenstein 
et. al. concluded that information style appears to be relatively stable over 
I6ng periods of time but is definitely affected by changes in the informa- 
t ion environment. The l«trodu^:tion and, avail^ability of online bibliographic - 
searching is just s'^h 'a change but the response to this innovation may 

Juaers differently: Herner reports/that basic scientists tend to - 
Lr own literature searching, whi^e applied scientists tend to have 
literature^ searches done, for them. He explains these finding^ by pointing 
out that the basic scientist, unlike the applied scientist, needs to. interact 



c^ "i r t' Rubensteln, et. al. . "Explorations on the Information Seeking 
f/^«""hers,' in C. E. Nelson and 'D. K. Oollock, eSs. , Communication 
Scleny^ «d Engl^^ (Lexington, MA: Heath and Company, 1970), 



. with the literature and that such Interaction ca^ot be delegatec}.* . 

Such attitudes toward' the literature will- clearly affect Attitudes .toward 

/ ■ ' ' . - ' * • ' ' ' ' ■ •/ . . 

. online searching. , o . 

Information style is also related to a person's, evaluation 'of the- ,yalue 
of Information In a glv^ situation. Hall, In his study of -the' values 
placed on Informatloft by scientific and technical Workers ^ observes*' that 
V different types of users have different criteria fori evaluatlng^lnformatldn 
' and Information systems, and. an Individual's cri'tetla may change as his role 
change*^s, iJe., from researcher feo planned *to administrator. This variability. 

Inevitably Influences a person's Irtformation style at any particular time. 

■' ■ ■ . ' _ _ V v. ' ' ' ^ 

Hall notes that researchers ;^f or ' exanpipn^, appear to ^lace the highest value . 

' '■'■^"■V ' ' ' / ' * ' ■ • ' 

^upon the qualitative U^pects of Information systems,* such as coii^?enl&1»^, ^ 

Eligibility and responsiveness. The research scientist also tends t?o want ' 

comprehensiveness In locatl^ Information, and frequently wants to obtain 

original documents.^* ' Convenience of. lnft>rmatlor^ Isf another Important 

, ' ^ . '• > V , . . " i ■ 

ci^iterion for scientists. <En a study of, lndustri'^1 and academic chemists' 

uise of both offline and online compu'ter-s^rched systems, ^mett concluded . 

chemists procure information from the sources which are closest at 

hand. , The .availability of online systems affects all of these values. 

\ X A study by Alien and Gerstberger implies ^at information $tyll is also 

influenced by the amount of experience a person has with a given info*rmation 

channel;. Th^ir study of electronics engineers showed that there' was a * 

strbng positive relationship between the degree of experience with a given 
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2. Saul Herner,: "Information Gathering Habits of Wotkers in Pure and 
Applied Scienced,^" Industrial and Engineering Chemistry 46 (1954): 228-36.: ^ 

3. Homer J. Hall, User Values In the .Selection of Information Services > 
(Linden, NJ: Exxon Research & Engineering Company, 1977). EXXON/GRU.l " 
DK.77 (final report)..^ . 

4. E. M. Arn^fttti^- .'Computer-Based Chemical Information Services," Science 
170 (1970): 1370-76& ' ^ — 
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information channel' and the perception of that channel's accessibility 
and easp of uaeP . In other words, the more often a channei was used 
to gather information, /the lower the perceived cost of using that channel. 
The effect of experience anrorrg u^e'i;s in this study is reflected in the 
contrasts^ between heavy , medium and light usage>, discussed elsewhere ^ 
^. .in this report.. ; ,\. i . - , ^ • , , , , 

The effects of the introduction of * computer'-based bibliagraphic 
"'^^rvices in various environments hasi' been reported' by severki^ investigators, 
although little.^omparative study, among environrifehts ' (a^ attempted in' this 



jtudy) hWs 



-present study) hVs been reported* Online services were made available 

■ • r ' • ' , > . " ! ' ' ' 

< I ' ' ■ ' ' ✓ - .. 

to researchers at the Exxon Research and Eagineering Company with the 
conclusion that the researchers- both accepted and became accuspomed to the 
n^w information system* \ « - ' ' 

^^^^^olthurst and Shilling stujdied the introduction of online searching 



into An industrial research center, ia chemical and biological sciei|||s. 
Since SDI service had ^existed for some years and was well accepteti, it was 



expectexi that online searching would also be accepted and .thisywas, the 
case.' User reaction was tavorable, with four primary uses: for new ideas 
or topidj in the start-up of long-term projects; to search for new topics -with- 



in an existing field of research (tUe majority of search reques4:s); to ' 
compliment SDI service; and to search topics where library materials were 
inadequate. The availability of the online system appears to have encouraged 
more queries of the types reported.^ 

■ T' 

5. Thomas J. Allen and Peter G. Gerstberger, "Criteria for Selection 
of an Information" (Working Paper 284-67,' A. t>.'sioan School of Management, 
Massachusetts Institute of Technology, September, 1967). 

6.. Barbara Lawrence, Ben H. Weil and Margaret H. Graham, "Making On- 
Line Search Services Available in an Industrial Research Environment," 
Journal of the American Society for Information Science 25 (1974): 364-369. 

7.. J. P. Colthurst and M. E. Shilling, "On-Line Searching in a Research 
Environment," On-Line Review I (1977): 311-317. 
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Changaa In information style of scientists caused by computer retrieval 
systems have he^n sugge.sted^'^by' several studies.^vA 1975 study by Blase of ^ 
health science library users at ^the; University of Washington contrasted 
reactions to the use of a printed current awareness service with reactions 
to the use of an offline computerized retrieval system (SDILINE) . SDILINE ' 
2,\^(f^ 3een by users as being of major value in alerting to new publications 

a 

in fields of Interest but, in general, the computer-based system did not 
change the literature scanning habits of most of the users Martin 
and Parsons, in their study of academic SDI users at the University of 
_ Texals found that while one-third of the respondents felt that a computerized 
SDI service had altered their method of keeping current with research, 
almost two-third^ felt that their information style had not been affected. 
The primary change reporfed was in decreased review of the literature in 
fields of Interest* ^ 

, It is Important to note that the studiea by Blase and by Martin refer 

to SDI service, that is, computer-based but in an offline mode. Even with 

. ^the inherent delay of Such a system, some impact on information style is 
discernible bu.t not definitive. Of concern ip this study is ,the impact of 
an online, interactive and immediate response^rstem. In the context of this 

^ project, SDI service was .a nilnor aspect. Most users wanted help in 
searching specific, non-recurring^ requests . Before online searching was 

introduced, the Information style of most of the academic users could be 

J 

generally described as personal scanning. of selected journals in fields 
of interest/ maintenance of clipping or card files on articles of interest, 
and manual literature searched, based usually upon the printed version of 



8. Nancy G- Blase» SDILINE Evaluation (Seattle, WA: University of 
Washington^ 1975) ^ ERIC ED 122775. 

9' J. K^ Mat'ttn and R. G. Parsons, "Evaluation of Current Awareness 
Service for physlQg and Astronomy Literature, Journal of the American 
Society for Informatio n ^Science 25 (1974): 156-161. 
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Chemical Abstracts or upon printed abstract and index journal^. 

This literature searching was supplemented by information contacts with 

colleagues, use of personal files, 'and attendance at professional meetings. 

In assessing the impact of interactive online systems on scientists, 
Curtis queried a small sample of scientists in the biologijcal fields and 
* concluded that "the use of on-line search systems by active bench bio-. . 
scientists employed largely in academic -institutions will increase only 
gradually in the immediate future, that it will be most heavily used by 
junior scientists, and that it will be considered a secondary information 
source of moderate value. "^'^ 

Finally, a survey which indirectly suggests the impact of online 
systems was done by the System Development Corporation. This survey 
reported on comments from over 500 organizations of all types which pro- 
vided online searching services. The information system managers reported 
favorable reactions from users to the new system and, in' over half of # 

the organizaftions , there had been an incre^^ in the nUmber of users .of the 

. * • ' . . • ^ ,^ . 

online system and in the number of search -requests received. 1^ 

These citations are indicative of other writings as well which show ' 
that online searching can become an accepted part of an organization's informa- 
tion environment and resources, and that users will make online searching f. 
part of their information seeking pattern, either as a major aspect of, 
or as a supplement to,- existing methods. What is needed is more definitive, 
study orx how online systems influence information style in a variety of 

environments and What the effect means to institution managers, system 

. ' , ■ ■ ■<* 

-'1 ■ * 

vendors, and to the users themselves . It is to this concern that the\present 

■* ' — ^ . 



10. Dade T. Curtis, "On-Lfne Retrieval as an Information Source for ^ 
Bench Bioscientists ," On-Line Review 1 (1977): 279-288. 
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jstudy is addressed. ; " \ 

Use of Intermediaries , ./ ' ' \ . ' . 

The way a' potential onllhe system user can and in^uSt interface with the 
system has b^n a subject of much interest and some 'study. . An aspect of 
Particular concern is the rol^' of'the intermediary/ the\specialist who does ' 
the "hands-gn'^searching. Marron and Fife highlight the 'reason for interest 
^ in this asplct: "The^ assumption that online systems, with\ their capability . 
for direct/and immediate access to information by all users,, would auto- 
matically improVe search performance and satisfy user needs, has not been 
•borne out in many cases. It is itonic that online ^searching Us most often 
done by' the intermediary - the very person the online capability/was supposed 
fcb replace, Recognition that the user community is heterogeneous, that 
not all users need or want to be online, and that the cost of training all 
users is high in both'time and money, are factors in this trend." 12 

Lehigh University -s^LEADERMART online search system was designed from 
the start to be user-oriented. Howler, Christian points out that there 
were problems "because researchers>were so seldom permitted to refine their 
searches 'hands oH/ i.e., interacting directly with the' data base itself." 

• ■ ' •» . ' • . ■ 

He goes on to say that '1[lmost 'uniformly, experience with machine-readable 
data bases shows that a trairied intermediary is definitely needed between 

■ . ■ 

the individual searcher and the system. "13 

* - A study of the use of online searching at a -NASA research center observed 
that scientists and engineers were not .using the search system directly and, 
further, ''they prefer, for fthe most part, to entrust their needs to that of 



1. 



12. Beatrice Marron and Dennis Fife, "Online Systems - Techniques and 
Services; the Role of the Intermediary," Annual Review of Informa tion Science 

and Technoloi^y (1976) :165-210. ~~ 

' » ^^'^^^^ Christian, The Electronic Library; BiblAgrap hic Data ' 
Bases 1975-76 (White Plains New York: Knowledge Industry Publications, 
1975), pp. 55-56. / ' * 
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an emissary - an intermediary - if , indeed » 'they "use it at all."* The study 
concluded that the center's new 6perating philosophy would be. one of "open 
"jrecognition that an inteniiediary kll be' the principal interface with the ' 
system" and that nfore formal training would be given to these information . 



14 

assistants. 



The use of an intermediary "was studied at the^ research center of a 
major petroleum company where most of the users of an. online. system were - 
chemists and engineers , and 'where the intermediary had a chemistry back- 
ground. The interaction between the user and the intermediary was one ■ 
of the factors in producing useful searches. As search results appeared. * 
the requester often revealed more details and th^hrKie purpose of the 
search. Further,- the combination'.of the intermediary-specialist and the 
requester Improved search quality because "this combinatfon softens the 
psychological impact of dealing with a- computer." It was also found that 
"although :5)eople are not too eager to learn how to do on-line seatching" 
for themselves - - this did not dim their enthusiasm for this txp4 of , 
searching. They seem quite happy to work as a team with an Information 
cheilst." ^5 \ - 

Not everyone feels positively about the involvement of an intermediary 
in the state- of online bibliographicsearching; some contend that users 
are/denied direct access to search systems because these systems are so' ■ 

complex that they require a trained intermediary to do the-ffdtTxal-ffearch 

Ing. "This fundamental limitation on the syptepis increases' the total . 
cost of searched by requiring a trained intermediary." This can also reduce 



14.. Adelaide A. Del Frateand Jane T. Riddle, Computer-user interaction 
does it exist? Paper presented at the Forum on Interactive Bibliographic 
Systems, National Bureau of Standards, October 1971, p/inted in the 
ASIS Proceedings 36th annual meeting, Washington, D. C. 1973, v. 10, p. 45. 
, 15.. Lawrence i Well, and Graham, o£. cit . " , ' < 



the effectiveness of searches'. » ' , 

Hock, from his review ojf*'the use o^ bibliographic data hases in« academic 
libraries, notes* the limitations stated by Gardner and. Wax' but po'ihts .out 
that the advantages of using an intermedia*ry^^re less time and cofit .consumed 
by searches. Disadvantages of a user doing self searching include the need 

for use^.. training and the likelihood that occasional users would be unable 

- ■' . . ,p • 

17 ^ > ' 

to take full adv^ntag^ of the system's capabtlit?ies. ' A ^ 

Finally i\ In a study focused on the user interface with searching systems,^ 

Zipperer paints out that the human intermediary allows the search process 

o be adapted to each user's needs and situation, inexperienced or unsure 

lisers can be given psychological and social support, while experienced users 

dre helped to make thjair searches as effective as possible. He'concludes that 

the! results of the study support the ^)osltion that "human intermediaries 

must be retained as an integral- component of a network model." He sees ^ffe 

human element as critical for problem solving and he thinks that programmed 

instructional assistance for user's might eventually become more .effective 

•"but^at least at this point it is not conceivable that wide and successful 

usag^ of a isearch system can exist without the human intermediary." If users • 

are to interact directly "then extensive diagnostic or error detecting mechan- 

• isms, are needed ta protect both the user and the system . . . It is doubtful, 

however j/'that any automated system can ever approximate the human intermediaries 

— fael41-ty-bf-4cnowlng the user means ' no '|Dr 'maybe'* when -he says 'yes'."^^ 2 

. * Given the opportunity, will end usel^Wo their own searching? In the 

present study., all Phase I and Phase II searches were done with the aid 



16. Jeffrey Gardnervand David Wax, "Ori-line Bibliographic Searching," 
Library Journal joi (1976) :1827-1832. 

. 17. Randolph Hock, "Prov!l^ding Access to Externally Available Biblib- 
graphic Data Biases in. an Academic Library," College and Research Libraries 
36 (1975) : 208-215. 

ij 18. W'. C. Zipperer, "User Interface Models for Multidiisciplinary ^ 
Bibliographic Information Dissemination Centers." ERIC ED 122846, August, 1975. 
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'of an intermeditfary, while during Phase itl, self s^airchlng was permitted 

. ■ ' "-"..^^ . . ' ■ * ' -' 

:-- a number af-Q se r s r esp ondig d» many ~af-^hian~nBv-T6~i3nllne:^^ 

•* ■ ^ ■ 

Relatively little has been published on self searching experiences, but 
-Egeland reports on the online searching of biomedical literature for 
physicians, researchers and students, where self sear.chlng was allowed. 
Egelahd points out that, after the Inltlalr novelty had worn off, even the ' x 
xiseTS who atiflrst expressed willingness to do their own searches became less 
and^^le^«.^jjit^ In spending the time required. Users continued to 

express interest in and satisfaction' with the online system but they 
requested that someone perform.the^searches* for them. 19 

The Washington Area On-Llne Users Group reports similar experiences 
among its members. Although end users were trained, after some time 
elapses, few of them continued to do their own searching, and "the con- 
sensus s^v^lued to be that after an initial period of enthusiasm and 
excitement about 'going on-line,* the searching usually begins to devolye 
back onto libraries and information centers." The training" for self 
searching that does seem to take hold was done slowly over a period of 
months in a controlled situation. This was time consuming and expensive 
but apparently effective in creating a trained self seajjcher.^JKO 

It would appear that, at the present state of technology and systems, 
hopes for extensiveOself searching are unfounded and that, in most situations, 
users will prefer to have intermediaries do the actual searching. Financial 



19. Janet Egeland, "User-Interaction in the State University of New 
* York (SUNY) Biomedical Communication Network," In Donald E. Walker, ed.. 
Interactive Bibliographic Search; the User/Computer Interface (Montvale, 
' , . ^J^J: AFIPS Press, 1971), pp. 105-120. See also her article. The Importance 
of User Education and draining in a Multi-Data Base Online Information 
Network in Proceedings of the American Society for Information Science 
' IT (1974): 137-140. 
. • 20. Thomas M.Haggerty, "Education of On-Llne Users," 3ulletin of • 

■ . the American Society for Information Science 3 (19^) : 20-21.** ^ \ 
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Incentives are a definite factor, however, and can overcome reluctance to 

Q-pe rsonai—searches-. 7 :- 

Training of Searchers 

An Important concern with online systems Is the. amount of time and effort • 
required to brings searchers up to a level of optimum efficiency In Interactive 
searching. Aspects pf training include proficiency in using the terminal, 
knowledge of the dafj||||||N)ases to be searched, and understanding of the s^rchlng 
system Co be used. Knowledge of the data base includes content of the data 
record, vocabulary, indexing principles used, and availability and use of subject 
vocabularies and other search aids. Some questions to consider regarding 
training are: how- easy or difficult is to train searchers? Is Informal 
training as ^lseful'as fo|mal training? 'What approaches: to training are 
effective? Can a casual or Infrequent user be trained adequately enough 
to MSB pnllnei^. searching efficiently? / 
../ Marron and Fife, in their summary of recent writings on user training, 
point out that there are two types of online users, the intermediary and the' 
end user, and that the training provided one may not necessarily be appropriate 
for the other. They also cite Egelarid as reporting that the emphasis In^ 
online user training has shifted from education of end users to the education 
and training of intermediaries. Intensive training in vocabulary usage and 
preparation of search strategies; provl^on newsletters to users; periodic • 
workshops; "hands-on" orientation to the terminal; online and telephone access 
for consultation and resolution of problems; computer-assisted lnstruct:^on 
simulations in conjunction with the online retrieval system; and multi-media^ 

presentations which couple new online techniques with known manual retrieval 

' . ' 21 

techniques are some training approaches whlch^ have been described. 



21. Marron and Fife, o£. clt . Section on User Training. 
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Gardner, Wax and Morrison state that regardless of whether V^tiSe actual 

searcher is a subject special i st or a lib ra rian, a more or less 'f ormal 

training program is essential. This training may last from one to six 



months and include classroom teachiifg, practical experience, and follow-up * 

sessions. They also note that in situations where multiple data bases • 

are accessed and several searchers are used^^^ it is typical for one person 

to "specialize" in the use of one or two data- bases. This specialization 

allows each searcher to become thoroughly familiar with one data base 

22 

and presumably, permits more efficient searches. 

Gardner and Wax say elsewhere that online searching, as presently 

■ ■ r 

done, requires libraries to make an "on-going commitment" to the training 

of professional librarians in the mechanics of searching. The result, they 

say, is that end users becom&^^ninvolved bystanders .^^ 

Chalmers reports on a study of five training methods for the novice, 

occasional user* of online bibliographic ^system. These methods were: system 

^ instruction only (providing a set of instructions plus online responses); 

system instruction with the addition of reading a systems reference pamphlet; 

^systems instruction with the reading of a manual on interactive searching; 

system instruction plus a training lecture; and systems instruction plus all 

of the others. One conclusion of this study was that the'amount of human 

assistance needed by searchers for their first session was statistically 

24 

equal, regardless of the kind of preliminary training. * 

^ Training takes time and time is money. In his study of ati^ academic 
library setting, Hock found that an average of 3.3 hours of computer connect 



22. Jeffrey Gardner, David Wax, and R. D. Morrison, Jr, "The Delivery of 
Computer-Based Bibliographic Search Services by Academic and Research 
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23. Gardner arid Wax, o£. cit . 
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time was heeded per searcher in preparaticm for his_first search. The^; 
-inltlal^ear^hes-by-a-uew-searcher natiiraily--tend^-iu?--take-J>onger_but^the_ 



average search time drppped 11 minutes from the first month to the second ^ 
month of actual searching. Charg^.ng this differAice to training costs gives 
a cost of $140-$280 of connect time per person, depending on the data 
base used. ■ 

A study of xiser training on an interactive system in a British hospital 
was reported by Kennedy. He found that the user's attM^e toward computer 
systems is important when considering the acceptability of the system and 
the user's preparedness to cooperate with it. . "For this reason it is 
essential that the training method dops riot antagonize the subject and con- 
v^sely it -should produce a more favourable attitude at the end of the 
training program." Since most of the subjects being trained were under 
great tension at the start' of the training, the' use of reading materials , such 
as a manual , ""helped ease this tension. ^The- users were given a choice of 
learning from the machine ox using a manual, but almost universally, the 
machine provided self-teaching which proved most effective. The concept 
of learning by trial and error* with feedback from the machine gives better 
performance than just demonstration. "Overall, the results of the trial 
indicate that self-teaching is a most effective method of training on the 
interactive system." 

A study of users at an industrial research center suggested a similar 
conclusion, finding that the biggest barrier to users has been broken if 
people can sit down and begin to search after only brief instruction. The 
quality of related training and materials is also important. "The ease 



25. QHo<:k, o£. cit . 

26. C. S. Kennedy > "Some Behavioural Factors Affecting the Training 
of Naive Users of an Interactive Computer System," International Journal 

of Man-rMachine Studies 7 (19J5) : 817-834. 

ERIC > 50 



of learxilng a system is also definitely- related to quality of tWlnlm avail- 
able. . .In learning a system's full capabilities. .the <jualf^^ of ^ the' 
system's users' manual and Its Index prove to be the most^ Import ant. key^ to 



continued success.*' 27 - ' h 



In the present study training of IritSBrmedlarles was done by the/^hllne 
system vendor and^y In-house tutoring, ''jralnlng of end users for- sj^ij:* 
searching was done by the .online servlceVstaf f 7 using lecture, specially 

^ prepared materials, ahid hands-on exposure to the system. The effectiveness 
of „ these training methods la described elsewhere In this report*. 

■ User Evaluation 

The satisfaction felt by the ultimate user of an online system ls'"tW^ 
primary criterion for the value of this method of Information seeking. 
There Is, however, no simple deflaltlon nor single measure of that satis- 

faction. Tessler and colleagues point out that, to a large degree, 

#■ 

satisfaction Is a state of mind - -an Intellectual and emotional response 

■ ' ■ • • 

experienced by the online system user. Satisfaction with system output is 

• , * * ^ " ^ 

usually the measure emphasized in most studies but other considerations are 

^^Iso Important, they believe, including user feelings toward the particular 
service and toward interaction with the intermediaries, .The degree of 

^ satisfaction may be influenced^ both by the user's expectations and by the * 
perceived costs of using the servlce.^^ ^> 

Most studies of user reactions and evaluations report a favorable 
response and positive attitude toward online searching. Unfortunately, many 
of the published studies of user reactions are based upon small samples, 
often no more than two dozen or so responses. Hoover's study of end users 
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at the University of Utah library was based upon 26 responses , " while 
Fosdlck's similar survey at a small engineering library llkew;|ype reflected 

26 responses. fcurtls' questionnaire survey of blosclentlsts-^was based 

31 ' ■ 

upon 57* replies.*; In all cases » most users' expressed satisfaction 

with online searching. 

The more extensive survey by System Development Corporation report^ on^ 

ove2#1200 feplles but these respondents were primarily Intermediaries 

rather than end users. The Intermediaries were asked about end user reactions 

to online searching compared to previously available literature searching 

services, and of those respondents able yto make comparisons, about two- 

thirds reported a favorable end user'- reaction; only three percent reported 

32 

unfavorable reactions. In the Lockheed study of online services 

In several California public libraries. Summit and Flrscheln reported 
that about 70 percent of the patrons found online searches to be "of 
considerable or major value." 

Marshall's survey on science departments of U.S. academic libraries 
found, that online searched met user needs "most of the time" In 83 percent 
of the cases, and "all of the tlmt" In about five percent of t]/e cases. 
Online users at an Industrial research center found even negative searches * 
useful; the requester had definitive results which he could accept because 
he knew that several search strategies had been tried. / ' - 
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User satisfaction alsd appears to be related to>hether or not the 

■■ ■ ' -^-^ ■ *. ■ f 

user was present for thje search, flock says, "The ^ilinpf iBsslon has been 
gained that requesters who were actually present for the searches seem 
frequently more satisfied than those who opted to delegate the search." 
He believes this Is dt^ to the Increased relevance of what was retrieved 
and the ability of the user to better understand the capacllltles and 
limitations ^f the search' system. ' This Impression seems to be 
supported by findings of this project, pdlrtlculal^ly when comparing 
the academic with the Industrial users. . 

The benefit of online searching most often mentioned by users is 
the time saved in checking published materials, compared with manual 
searches. Anyone who has had to do an extensive manual search through 
printed documents can readily appreciate the value of a^ system that' can 
reveal more references in ten minutes than a manual , search could reveal 
in an hour. Elchesen documents that approximately five online searches 
may be conducted in the time required to perform a single manual search, 
and with generally better results. ' In the Blase study already cited, 
one-^thlrd of the users reported that online searching saved a significant ~ 
amount of their time. 

In the present study, most users in both the, academic and industrial 
environments expressed' satisfaction with online searching, both with the 
results obtained and with the process of interacting with ^ the system. The 
statistical analysis of user reactions is reported elsewhere but some 
typical user comments suggest the feelings of many. One industrial bench 
i^hemlst said of the online system that he was, "so doggone happy with it" 
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after having to do manual searching for so long that he didn't see how 
the system could be Improved. An academic research associate wrote, - 
J "The results of these searches were of great help and saved me time." 
Another academic searcher said, "The amount of time saved by this oa-llne 
search Is phenomenal, and If we were being charged for this service, 
the actual cost of the search would be well justified." Several academic 

users emphatically agreed that their work productivity had been notlce- 

" - . ■ ■ • . ■ • -^1. 

ably Increased because online searching ,was available. ' 
Effect of User Fees 

Since Phase II of the project Involved some form of search fee 
charged to the user, the Ijnpact of Instituting such a fee after a period. 
> ofi free searching was a matter of Interest. Most academic and research 

' •• ' , 

: ; libraries recover at least some of their costs for providing online 

: •. ' .A ■■. . . , ^ 

searching because they are financially uMble to do the searches other- 

wise.- The methods of charging include: charging for actual terminal 

connect time and printed offline citation^; charging for all related costs 

including staff time; or having a standard (flat) fee for all searches. 

In some -cases, there may b4 special student rates and, in academic settings, 

charges* may be applied against departmental budgets or research grants, 

as well as being paid for personally/ 

• ... f 
The imposition of fees clearly affects patron use. Gardner observes 

that in those instances where user fees have been initiated after a start 

up period of free services, use has invariably dropped dramatically; where 

user fees have existed from the beginning, use has expanded slowly. ^8 

Hoover 's study at the University <^f . UtaH? showed that about 80 percent of 

the users said that they would^bntinue using the search service at an 

increased price ($5 instead of $3), and after the price was actually 
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lncreai|«d» "use by-? all ciasses of patroixs conslstiently Increased. • . 
there was no noticeable drop in use of the se^rvice when the new higher 



pri"ce$~went~in t o~ e f 
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~Firschern and SummTt "reviewed online 
use at four Calif orn;^ public libraries over^three phases: a no-charge 
period, a charge of otAe-hal? the normal cost, and a phase in which the 



patron was charged th^ f ull cost of . the onl.ine search. With the intro- 
duction of the: half "C^t fee in the second year of the project, there was 
"a large drop iii demand 'V for online searches, but going to a full cost 



fe^ made littl^.difd^^*^hce in the volume of searches or patron attitudes/ 

In the ^ijc^sent slii^dyf a period of free searching was followed by 
a period of half-cost iftthotgh indirect) charges. The effect of this fee 
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can be s^een in the co'jg^e^f searches done and, graphically, in the plot 
of weighted average searches . 
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PHASE l ! ^FREE, MEDIATED SEARCHING ' 

conducted at FSU for eleven months (late May 1976 to late April 1977) and 
at Monsanto for thirteen months (late March 1976 to late June 1977) . This 
phase of the project was characterized by fre^ searches for users, 
services provided in two conti^asting environments, artd the use of inter--^ 

mediaries who helped ^ers refine queries and performed the actual online 

' ■ ■ " ' .' ■ ' ■ ^ ■ 

!K searching. ' * 

' v. , - ' ■ 'y ' -r • ' ■ ' - . ■ ■ • 

'^ Sample Participants ' ' . 

At FSU, the project participants were 70 academic chemists, research 
associates and graduate students who completed detailed questionnaires on 
their Information habits, prior to the introduction of online searching. 
Of the academic participanj:s , 57 percent held the doctorate degree; about 
one third: (36%) were faculty memliljTs , while 37 percent weret advanced 
-doctoral students, and the remainder were research associates or post- 
doctoral fellows. Of the academic sample, 71 percent were bom in 1940 
or later, and 87 percent,. wexe_male— . — 

At Monsanto, 262 scientists and technologists completed similar ques- 
tionnaires. Of the industrial participants, about one-third (32/^) held 
doctoral-level degrees. Three-fifths were trained in a field of chemistry, 
while one-fifth were trained in engineering . One-fourth (26%) of the 
respondents were identified as supervisory personnel, while the remaining 
three-fourths worked in non-supervisory positions , such as bench chemist 
or research associate. About one-third were born in 1940 or later, and 
90 percent were male. 

During this phase of the project 345 searches were conducted for 108 
out of the 262 eligible industrial participants , while 353 searches were 
performed for 51 out of the 70 eligible academic chemists. 
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Questionnaire Survey , " , 

. - ' • ■ ' ' , ■ ■ • ' ■ ' 

Prior- to the Introduction of online searching, Monsanto partjlcipanits " 

responded to a questionnaire of 108 itemg, while FSTT p articipants-Xe p lie d-^ 

to a similar questidnnaire. There were some variationsi.between the two 

questionnaires in the number and wording of questions due to differences 

, ' / ■ " ' ' ■ . . ■ ' . 

in applicable categories between an academic and an industrial environment 

(see Appendix). These questionnaires were designed to assess personal 
backgrounds, recent and present job requirements and related methods 
of jLnf ormation seeking, and prior experience with online bibliographic 
search services. Questionnaires were distributed through inter-office 
mails at both loc^ions with telephone' and mail followups to non-respondents 
A cut-off date was established and only thoise questionnaires received^ _ 
by that point were considered for data analysis . A usgl"^ identification 
number was assigned to each questionnaire • 

l^ach question on the retur/led questionnaires was coded for computer 
analysis ,, using optical character recognition input. Statistical analysis 
df . t)ie data was done using the Statistical Package for Social Sciences 
(SPSS) computer program; an example of this output is found in the Appendix. 
Outputs were prepared for each test site individually and also with com- 
parative data between the sites. 

Following the conclusion of Phase I, a post-treatment questionnaire 
(see Appendix), was distributed to participants. Because of losses due to 
job transfers or departures from campus, the number of respondents to this 
second survey were leSI^'than at the beginning of the project; post-test 
respondents at Monsanto totalled 234, compared with 262 who completed 
the pre-test, w^|^e 50 persons at FSU completed post-testa, compared * 
with 70 pre-tests. 

Inf. ormation Specialists. 

The intermediaries, or information specialists, at FSU during the 

■ ■ . ■ f • . ■ • 

■ • ■ ■ 



project Included three library science doctoral candidates, one library 
•science masters' student, and one person with a masters' and course work In 
biolQgy_and_chemiatry-* — Foun-yere- f emale,-one-wa8-^^male> — The-two-specialist 
who worked on the projects at Its start, along with one Monsanto specialist', 
received two days of on-site training from the vendgr. System Development 
Corporation. The two FSU specialists In turn trained the others who came 
later (although one of the later specialists had prior experl^ce with the 
SDC system). 

The Initial concern of the library science searchers was over their 
lack of knowledge of chemistry terminology and concepts, while the searcher 
wlfcjr the chemistry background expressed hesitancy about the query negotla- 
tlon process and techniques. The subjective assessment of all of the 
specialists was that subject knowledge, while helpful, was not a necessity 
for effective searches In perhaps 90 percent of the Interactive situations. 
More Important was an understanding of the data base, the. Indexing prlncl- 
pies used, and the design of efficient search strategies. 

Tlie two searchers (both male) at the Monsanto facility In Pensacola 

_were p_rQfej3j3ijmal_^^ of the company library, with knowledge of- 

chemistry research and some prior experience with online systems. The 
searcher (female) at the Durham site was a company librarian, also familiar 

with chemistry research queries. 

Test Instruments ? > 

jTlnstrumeiit^use^ydurlng the course of the project were for data- 

gathering. , In ad|^CT^ to the pre- and post-treatment questionnaires 

already described, ther^^ere the Ii]if ormatlon Specialist's Record of Online. 

Use, the User Reaction Form (see Appendix) and, at FSU, a logbook for 

Informal observations. 

The Information Specialist's Record was prepared for each search. 

Part was completed with the user, while the rest was completed by the ' 



Infomat ion specialist alone, this record described the type of search, 
the user's need for the Information, expectations of results, prior Informa' 

_JtiQnLaeeklxig.Joii_thlB_topic^_and^ 

results* To this Information the specialist added the d'atabas/e used, 
online time, offline citations printed, system problems, and other objec- 
• tlve aspects of the Interaction. 

The User's Reaction Form was designed to get the. user's assessment 
t)f the pertinence and value of the output produced. This was a simple 
. form, with four short-answer or multiple-choice questlonis, plus a ques- 
tion for general comments. ' 

With , the onllne/^results , the user was given a User Reaction Form to 
coioplete and return to the project office (or, at Monsanto, the library). 
When offline citations were being printed, the reaction form was held 
until the offline citations were received, then, attached ''to the offline 
and sent .to the user. " ' 

\A completed User Reaction Form was attached to the corresponding 

• ■ ■ > ■ . - ■ . . . 

Information Specialist's Form to jcreate a search "feedback form." This 

feedback form was then transcribed, item by item, onto optical-character 

recognition sheets for entry into computer file. Records from Monsanto 

were received perioidically at FSU during the project and transcribed in, the 

same taanner* . " * ' 

The logbook of observations (FSU only) was essentially a diary in which 
the information ispecialists noted unusual search queries, significant 
user comments or reactions , and^echnical notes on system operation or 
search •strategy development. This logbook provided continuity among the 
different specialists and provided a resource for illustrative, material 
to supplement the statistical analysis and reporting. 

The reporting and analysis instrumentis were primarily the monthly] 
search reports prepared by the specialists, and the variety of computer 



outputs : from tht SPSS program. The monthly repdrts summarized usade by 
type of U8er» shoved total' searches and unique sea;rrchers9 and recorded 
_pcrtliient--averafees» — ^Thls^report-pravlded a-basls-for-monltorlng-ue age-and- 
for diBclslon^^'SVi/st^^ 



The computer outputs were oj||seyeral types and Included all appropriate 
8 ta:t Is tlcal calculations, as vellj^as tabular presentations of x key variables 
against all questionnaire Items and against usage variations . ' 

. , ■ ■ ■ . e 

" ■ *■ ■ ' 

Philosophy and^Publldty 

The philosophy of 'the search service was to provide a maximum of online 
searching within the capabilities of the system- This meant that no real 
limitations were pJLaced on' such things as citations printed (although 
quantities above about twenty were usually printed offline) or on amount 
of time spent in conducting a search. As much tiine was taken in query 
negotiaitloii as seemed necessary and users wete made to feel welcome and 
encouraged to use the service often.' ^ 

During the coutse of Phase I, publicity about the service and encourage- 
ments for its use were made periodically. At Monsanto, the library director 
.presented a series of lectures with demonstration to various technical groups, 
as well as promo tingr.^ the' service through memos to sample participants. 
At FSU, presentations were made to faculty groups, reminder memos were sent 
on several occasions to sample participants, and some faculty members described 
the service to their classes. As has been found in other situations; word- 
of-mouth publicity is also an effective ch^nel. 

■ft 

Query Negotiation " , 

la most cases at both FSU and Monsanto, users came to the search service 



* office or library to present and discuss search requests. In some cases at 
Monsanto, search requests were received by telephonis or by mail, Discussions 
of the request (if)eg9tia£ion) took place to clarify the request by determining 
' intended use, possible synonyms for' terms, limitations on the search, e.g. 
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""by date» language or author, and correc't search logic. 

Initial users were given an e'kplanation of the purpose of the project, 
the content of the primary data, bases, and the method of interactive search- 
ing. The more Experienced users often appeared with their searches written 
in Boolean logic form but even infrequent users seemed to quickly grasp the 
basics of ^he search' process. 

^e negotiation process in interactive searching has been the subject 
of some research. On study in an academic setting reported by Zipperer^ 
identifies seven "events" in the user interface with an online system, and 
these events provide a framework for describing the interaction in this 
project. The events ar^ as follows: 

1. t Question negotiation - presentation arid clarification of the 

user's question. 

2. Profile development - ^.vocabulary related events subh^as selection 
deletion, and truncation of terms. 

3. Tutorial activities - detailed explanation of data base indexing 
policies, retrospective holdings, and data base coverage. 

4. Search type selection - choice of retrospective/current aware- 
ness or both. ^ . 

5. Strategy formulation - events 'concerned with analysis of the 
questions, identification of the concepts and specification of 
the relationships between concepts. 

6. System description - descriptions of general system characteris- 
tics such as search schedules and procedures. 

7. Data base^selection. 

Zipperer emphasizes that the process in not linear; it has no distinct event 

4 
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patterna and this was true with the negotiations carried out by the project 
staff. > • 

The typical user would arrive with the major concepts of his search 
written down and would offer,^ short explanation of his search topic. Some 
" . users explained their needs from memory. During this time of explanation, 
the Information specialist noted whether the user had provided synonyms, or 
logic and what Initial constraints, e.g.^ author; time period, etc., were 
mentioned. This phase of the Interview varied from new users who provided 
little elaboration to more experienced users who sometimes arrived with their 
search strategy carefully mapped out, 'completed with Indicated truncations, 
and logical combinations of search terms. The results of consultations with 
colleagues was sometimes evident, with some users building upon the results 
of other searchers' strategies, knowledge or experiences with the system. 

Question negotiation-, profile development, and strategy formulation, as 
noted by Zlpperer and confirmed by the specialists In this project, are close- 
ly Interrelated, and It Is not always possible to distinguish among them. 
Clarification of the query generally revolved around Identifying the separate 
concepts of the query and their relationship (s) with each other. The user 
was also asked about alternative ways of expressing his search problem through 
synohyms, acronyms, abbreviations, and related terms. 

The query nfegotlatlon process took varied amounts of time depending 
upon the user's experience and the subject being searched. Questions In the 
"hard" sciences appear to be more quickly definable because of the more pre- 
cise vocabulary used. In contrast to social sciences and humanities' where 
queries often must be discussed and refined at length to achieve enough 
precision for effective sWrchlng. Somervllle^ describing query negotiations 
for computer searches In an acadpmlc setting, reported that "the length of 
reference interviews may require between five arid sixty minutes, with the 
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majority ranging from twenty to forty minutes *" This Is supported by 
comments of the onlling searcher/librarian at the Science and Technology 
Department of FSU's Strozler Library. She estimated thdt the average 
negotiation, particularly In^a social science data base, took forty minutes, 
while negotiations for searches in chemical or medical data bases usually 

tfOOk less than ten minutes • 

- . ■ * • ■ " ■ - ♦ 

The statistics on average query negotiation for the searches in this , 

project are discussed elsewhere but most did, not exceed five minutes. There 

was relatively little time spent explaining details of the data base record 

or Indexing or search procedures; particularly to experienced users'. (Iti 

the secoii^^h^e of the project, a handout for users (dee Appendix) was 

prepared which explained search logic and how to prepare a search strategy 

but most users seemed content to work out a strategy with the specialist.) 

Search Strategy Development V-.v^ 

Most searQhes were performed only in the chemical data bases (CHEMCON 

and CHEM7071) although after BIOSlS and BI06973 became available, they were 

' * ' . ■■ ^i- 

also used to some'^extent . During the preliminary dlscilkssions , the Informa- 
tlon specialist would note the possible need to esiplore other data bases. 
Usei:s were made aware of the variety bf daft a bases available but most did 
not wish to explore data bases outside the chemical and blolo^cal fields* 

Since both chemistry and biology data bases had two separate files, 
divided by date, the discussion of data bases to use provided an opportune 
time to select the type of search - current, retrospective or both. Most 
users appeared to make this decision 1;>ased on the time period during which 
most of the work had been done on the subject of their Interest. > The num- 
ber of references was also a factor, particularly if the first data 
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base searched yielded f«ver or more citations than desired « - 

During search strategy development, vocabulary aldsvvere consulted 
as appropriate. The Merck Index and The Encyclopedia of Chemistry (Hampel 
and Hawley) were available but Infrequently used. The SDc\cHEMCON Index 
(April 1976) on microfiche was used extensively, whllt CA microfiche 
Indexes of word frequencies, phrases and key letters were used to a 
much lesser degree. These aids proved useful in identifying variant 
spellings, deciding on truncations , ♦.and indicating the approximate number 
of citations^ that might be geiverated. 

Prior to actual searching*, the search statements with agpropriate 
Boolean operators were wrlt^ten out. The strategy was spelled out as 
carefully as possible, not to preclude interaction but .to anticipate 



potential problems and to. develop possible alternatives in advance. The 
user, when present, was encouraged to participate by "thinking ahead" 
about ways his search could.be narrowed or broadened. 

Most academic users were patient with the negotiation and\nteractlon 
process. A few did not seem to become involved with it and would leave 
a search request with the specialist but not stay for negotiation. One 
user often Bfcought a written request to the service office at closing 
time, thus eliminating the possibility of much negotiation. Another 
user preferred to get online immediately without much written down and'* 
without any negotiation. A few users, after initial searches were per- 
formed for them, appeared with search strategies completely formulated and 
wanted little or no deviation* from them. Some of these proved hard to 
convince about matters such as the need for truncating or entering all 
possible synonyms and forms of « term to retrieve the most citations.' (The 
system proved a better teacher on these points than the information specialist.) 

Comparatively little time was, spent in either tutorial activities or 
system description. Users were told of the project purpose, the information 
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contained In the various data bases, and the amount and kind of Information 
that could be printed for citations. Users were also cautioned that 
although the online search took much less time than a manual search, Its 
results were no more current than the Information In the printed Indexes 
because of the lag time before a' pnbllcatlon Is Indexed or abstracted. A 
common misconception which had to be dispelled was that the subject Index 
of Che mical Abstracts father than titles and selected key words were being 
searched by the system. Information about the system Itself was interspersed 
throughout * the query Tiegotiation as * either the user made inquiries about 
specific capabilities or the intermediary identified a need for various 
features. ^ 
Informaf Observations f 

Informal observations by the information specialists at FSU will give 
some "flavor" to the way the search service was used and perceived. The 
very first search request was a difficult one because it was an exh-austive and 
complex search which required the linking of sev&tal concepts, each with 
possible synonyms (e.g., abbreviations, acronyms, dif f erent jj/ays of naming 
the same chemical compound) that had to be thought of and searched in the 
.microfiche for spelling variations. The user, a fourth-year doctoral student 
in physical chemistry, stayed during the entire search; in fact, midway 
during^ the negotiation period, he called his wife (also a student) to come 
see the search procedure and results. Both of them were Interested in. 
how the system worked and in how to formulate a good strategy, asking 
numerous questions during the course of negotiation. Although 40 minutes 
computer connect time was spent, the search was delayed by a Tymshare dls- ^ 
connect problem. Eventually 10 citations were printed online and 54 
requested offline. On his User ||;eact ion form, the user^ indicated he only 
Intended to pursue four citations for his oral presentation at a conference 
meeting. While the citations retrieved were "just about the right number," 

4S . 
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10 known citations relevant to the search topic were not retrieved. The 
user felt that although the "nice and friendly personnel" and the accepta- 
bility of the terminal were positive aspects, the search itself was "too 
time consuming (in terms of output /input ratio)." This, however, did not 
discJtirage the user from returning to use the service; he requested a 
sefcond search two months later. 

Another search request was from a graduate student approximately 
th ree weeks prior to l^er comprehensive examinations, after which her 
dissertation work would be started. The request, delivered in person and 



ijlf^^ting, was to cover seven data bases coordinating three separate 
^jiomSi^a^ In this case the search was broad aqd^ j^^roapectlve , looking 
^ for something that wW not theife''. Jokingly /^the^ irifotmation specialist 

was told, "if you fltid anything on and and ^ , bum the 

termlnall" While key concepts and some synonyms were supplied, others had 
to be elicited after a trial search on CHEMCON. The search was run over 
a two-week period and eventually 503 citations were retrieved. The user 
felt the search results for her intended purpose were "very useful." She 
commented that "while- there were too many citations, the nature of the 
search required a certaiji vagueness in order to insure that all potential^ 
developments in the area* . .were retrieved. Thus, the excessive number 
of citations was necessary." This user returned several months later when 
she needed more background information on her dissertation topic for 
oral examinations. 

Previous experience with online searching may have had little influence 
on initial interest in the service. Of the eleven original sample members 
inquiring about the service on the first-day of operation, seven had never 

used an online searcft system before, although they felt it would signifi- 

.-J 

cantly improve their curjent method of doing an information search. Four 



had used an online search system before;, three of these felt such a 
service would significantly Improve their current method^ of doing an 
Information search^ while the fourth was uncertain. * 

The most frequejit questions from early users observed by the Informa- 
tion specialists were J'how much will It cost me?", ''how long will you be 
here?" In fact, most of the early users seemed so pleased to have 
the convenient service that this probably resulted JLn a halo effect on the 
User Reaction forms. * ' 

Search delays fall Into two main categories: delays due to equip- ^ 
• ■ ■ 

ment and delays due to Intervening users. In general, users ^e^med to under- 
stand the host down, terminal malfunction type of delays. They returned 
when the search service was' expected to be operational or waited for 
notification that the search could be or was executed. Wh^n offline printouts 
were lost, users sympathetically returned with their initial online printout 
so the search could be repeated. ' ' 

There seemed to be no true pattern to lnter*yenit>g user type delays. 
Each user reacted differently at different times depending upon the circum- 
stances. When the information specialist was already online at the terminal- 
with one ueer, some chemists needing a search went off for coffee and 
returned later the same day; some, busy with classes, "boiling" mixtures 
and other things, did not return until later in the same week; sotne 
watched the search in progress; some waited their turn at the terminal in 
an adjoining room; one user came back several times, in one day waiting for 
the terminal to be free; one user offered .to get off the terminal so that 
others could have their search run; others preferred to make appointments; 
and still others Interrupted the information specialist at the terminal, 

handed her a scrap of paper with s6me key words written on it and rushed 
out of the room. 

Some users were very surprised with their search results . During one 
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search a post-doctoral fellow was startled to retrieve his own dissertation. 
In an author -search on a faculty member's own name, citations to documents 
jjj^by another' author with the same name were retrieved. That faculty member 
was pleased to discover why he had been getting strange reprint requests. 
The biochemists are often pleased to discover there is so much of potential 
interest to them in CHEMCON. 

Users have commented on the time saved by using the online search 
service. One faculty member remarked that a particular search had saved 
him about a week's work. He later commented that he used the computer- 
retrieved citations from another search to supplement, his use of Current 
Cotitents , searching his collection of reprints, and browsing in the library 
in order to get an article ready^ for publication. Some users depend upon 
the online searches more completely. One doctoral student remarked that 
"if the computer can't find it, then I certainly can't." 

Depending upon the particular topic, the number of citations retrieved 
may or may not influence satisfaction with results. One doctoral student 
was very satisfied with only three citations retrieved on eight compounds; 
except for commenting "too many citations," this same doctoral student was 
Just as satisfied with 147 citations retrieved on another compound. Another 
doctoral student was phased to retrieve no citations on a particular 
chemical he was synthesizing. 

. Most of the online searches were performed for research applications. 
These ranged from seeing what existed on a specific compound to exhaustive 

t " ; 

literature reviews for grant proposals. Online searches were also used to 
study for oral comprehensive exams, to learn about a seminar topic, to 
review recent writings of FSU faculty members and conference or colloquium 
.speakers, to browse for new ideas, to search for vaguely remembered articles 
written by other authors or written by themselves. Sometimes a user would 
bring in the title of a particular article and ask for further bibliographic 
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Information on It. Other times the author and his field were/known and 
the Information specialist was asked to retrieve his most recent article. 

Some student users readily admitted they were gathering data for their 
major professor while: others were more reluctant ^o admit the search was 
not for themselves, thus' making proxy searches sci|ietlmes difficult to unravel. 
One post-rdoctoral fellow reques^d a search to sefe if enough Information 



existed for her research professor, chairman of 4 p 

■ ■ ' ' i- 

committee, to arrange a symposium. On another c&c 



ofesslonal program 



Ion a search was 

negotiated and further narrowed online with one dpc^oral student; however, 
when the offline printout was requested he revealed the fact that the 
search was actually for another doctoral student who was "too busy" to come 
himself. 

Search referrals were also difficult to uhrayel. No doubt the search 
service was a topic of conversation in the cofit^e'room. Sometimes a new 

( ^ ■ ■ i ^- ^ ' ' ' 

user would volunteer that he/she was sent down i&y "X" or would mention having 
seen a printout. One one occasion a faculty lumber who had used the 
service the week before actually brought downjone of his graduate students, 
introduced him and left him to do a search. Sometimes a returning user 
would bring in someone new to observe a search being negotiated and sub- 
sequently this observer would return on another ochasion to lase the service 
himself. One chain referral case was particularly Interesting and was 
perhaps a measure of the initial user's satisfaction with his search. A 
faculty member, who had not at that time completed his pre-test question- 
naire, stopped by to see what the search service was all about. The informa- 
tion specialist suggested performing a search on his major area of Interest. 
Apparently this demonstration Impressed him for he completed and returned 
the questionnaire the next day. Several days later he sent a new user 
down, a post-doctoral fellow who was working w;Lth another faculty member. 
In fact, during this second search, he checked in to see how things were 
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going. A day laier another faculty member came in to ^ee the search service 
iset-up. He, in- turn, mentioned that his "post-doc" was in the previous 
day. 

TrainipR of Intermediaries , / 

If intermediaries are used in online searching, they^ust be trainid. 
the following methods can be used singly or in combination: introductory 
workshops or seminars, adequate practice time, training on specific data 
bases, or refresher training and updating. All of these methods were used 
at one time or another by members of the project staff. > 

Initially, at FSU, l^o information specialists were hired to be inter- 
mediaries between the online system and the i^hendsts. bne person was 
a doctoral student in library science, had servedy as a i^eference librarian in 
an academic institution, and had experience interviewing patrons with 
reference requests. The other person had a graduate degree in biology and 
some training in chemistry; thus she was familiar with the subject terminology 
Neither was familiar with online search-systems. 

Prior to beginning the search service, a formal training session was 
planned and subsequently conducted by the vendor. System Development Corpora- 
tion (SDC). Training manuals were provided to the staff for their study 
prior to the instructor's arrival. Some search requests were also obtained 
from Chemistry Department faculty members so the project staff would have^ 
practice with real searches. 

Two months before the beginning of service the SDC instructor arrived 
for a two-day training session. Those participating were the two researchers; 
the two information specialists from FSU; one information specialist from 
Monsanto; and the librarian-online searcher from the FSU library. 

Initial training consisted of an introduction for new users, including 
log-on and log-off procedures and the use of various commands." Two terminals, 
an Execuport and a Scope Data, were available for hands-on experience by the 



six participants • Later^ the requests which had been submitted by the • 
chemistry faculty were run as actual searches. Results were printed both on- 
line, and off-line as a training measure and also In order to enhance the 
relationship between the project and the Chemistry Department; 

More advanced training was then given with more Intricate search 
Strategies and commands being discussed. One faculty member brought In 
. a well-thought-out request for an online search, and participants observed 
as -the SDC Instructor conducted a lengthy pre-search Intftview 
using the SDC CHEMCON microfiche Index, the CA list of} s^titlons^^^^ 
actions with the user. Following the Interview the reqWsi ?w^^:^^ 
on the.ScWe D*^^ terminal. This gave the trainees an opportunity tp observe 
thi^ type ^T^ which takes place between the Intermediary and ^ ' 

the requestor ias well as ^ the Interaction at the terminal. 

When the remaining Information specialists were hired no vendor-provided 
training programs were utilized. Of the three persons hired subsequently, 
two were doctoral students in library science with experience- in reference 
departments of academic libraries and one was a master *i3 level student with 
some computer experience. ^ Instructions for these three people consisted of 
their reading the ORBIT anci^EMCON manuals and Informal over-the-shoulder 
or personal instruction given by the more experienced members. This was 
followed by additional on-the-job training, the use of the NTIS demonstration 
data base, and the study of previously run searches. 

After some, initial practice typing on the terminal and ^^lelping construct 
and. revise search strategies, the information specialists were given the 
opportunity to construct some searches on any subject deslted and then to 
perform the searches in the data base most related to "t^t subject. This 
served to acquaint the searcher even more with the construction of strategies, 
the capabilities of the system as well as with the differences between data 
bases; e.g., some have f|:ee-text searching while others have controlled 
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vocabularies; some allow multiword \:erma Q^l^^^ases;^oth word 
texoB to be entered and searched. S^¥>^ serylce/'^as* available to 

persons connected with the aieinls^p!||^^tment, emphj4^ia waS placed upon 



search rommlati'onis and strategifes^pll cable to the -chemistry data bases, e.g., 
CHEMCON and aiEM7071. ' ' ' 

The information speciallists felt competent enough to' perform searches 
for the patrons after the practice , with 'the NTlS "demo," repeating the previously 
done searches, and cd^evising original' searches. The' first few searches were 
done with an experienced' searcher as a back-up person in case of difficulty. 
After one or two searches, thfe*nfew information specialists began to actively 
perform searches for chemists. v . * ' 

Advantage^^^^^l^vantiges may be seen in the various methods iised for 
training. The SDC-sponsored training session had the advantage of being 
formally organized and conducted by the vendor who supplied the data ijases. 
It served as an, introduction to the ORBIT system and also introduced the 
basic concepts of searching to the search staff. A formally conducted train- 
ing session usually is fairly expensive and some of the-^participants in the 
training commented that an equal amount of money might be spent for pnline 
practice sessions on an unsupervised basis with e^tiel or better results 



One problem associated with over-the-shouldF:^^ personal instruction 
is the aspect of human bias which may enter into' the training. The instructor 
ma^ give his/her own interpretation of the '"proper" use, strate^gies, or 
commands of the system. Examples of this may be seen in the emphasis which 
one person may place upon string searching ^s opposed to the lack of use of 

that particicular command by another person. Persons trained by 6ther informa- 

^ ^ ■ ^ ... 

tion specialists may tend to use the .same methods and commands which were 
emphasized to them. A positive aspect of this method was the insight^ provided 
about the service clientele and their approach to the service. ^ ^ 

In both formal training and personal training the mechanics of searching, r 



I.e., teimlnal operation and use, formulation of search strategy and con^. 
cepts, wis re emphasized. Less emphasis was placed upon the Intricacies 
of the Individual data bases. I.e., their content. Indexing principles employed, 
and available search aids. Perhaps this was true because most of the Informa- 
tion specialists had experience working with printed indexes and abstracts 
In the chemical field as well as In other subject areas. 
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• PHASE I - ANALYSIS OF UsIrS 

Users and Non-Users . • - ' . 

Computer-readable^blbliog^aphic- d bases are Information retrieval 
, innovations gen^ej^l^rK^Iable for the past decade. While batch process- 
ing^has a longer history, widespread adoption of online searching has only 
.taken place since mid-decade. 1 Consequently, little tfolld empirical research 
Is available on the characteristics of users and nonusers of these computer- 
readable bibliographic data bases. Rather, much of the research has been 
;^o^^^ only on users,2 „ith generally small samples,3 and/or often with 
relatively low response rates t? assessment Instruments.^ Because of the 
relative recency of general adoption of interactive 'systems, these generaliza- 
tions are even more applicable to online bibliographic search services. 

In comparison, the present study, based on a relatively la^ge sample, 
collected comprehensive data on virtaully all potential users and subsequent 
nonusers of online bibliographic search services, prior to the introduction 
of such capability into the working environment. Standard deinographic back- 
ground data, measures of "information style" and information needs , and data 
on prior online search service use and/or Wuatiori . was part of this com- 
prehensive instrument. ■' " 

In this section, these data are linked to the prediction of "subsequent 
use or nonuse of online search services. ' However, some prior .research would 

1. J. J. Gardner, and D. M. Wax, "Online BibiiogrAphic Services " 
Library Journal 1Q1> f 197fi-> ; 1 «77-l < ' 

A Lawrence, B. H. Weil, and M. H. Graham, "Making On-Llne Search 
Available in an Industrial Research Environment," Journal of the Am erican 
Society for Information Scientists 25 (1974) : 364-369^ ^ 

n L^L °*.^* ^^^^^f* "On-line Retrieval as an Information Source for 
Bench BiogclentistB," On-line Review 1 ri974V;970-9«« 

'^l.^' ^' Pa'^k. "User Assessment of Copiputer-Based 
57oii?^of ^tJ'' ^^^""^^^^ Services , " Journal of Chemical Documentation 13 
(1973) :24r-z9. ' ~ 



suggest that ve might expect little relationship between these types of 
factoriS and subsequent use. In a recent ll^udy* of science and engineering 
faculty members in ten university department^ for example, demographic 

— attd-profes &l o ual -backrgroxmd~"chBrac.terl stie s , value-oxfentattlons r~ and p ast ^ 

scholarly productivity were found to be unrelated to use of a newly 
Introduce^^atch-processed current ^ awareness service.^ Similarly, a ^^ 
recent study of searchers and nonsea/chers with an online system found 

V little or no correlation with knowledge that searches can be made, avail- 
ability of search services', areas of research, age of individuals, and 

6 ' 

money needed to pay for searches. However, these particular studies were. * 
based on relatively homogeneous samples (doctorate holders); in contrast >• ^ 
the present study employs a byroad range of persons, with, substantial variation 
in professional training and experience, different work assignments and job 
_task expectations, and variation in the need for technical information 
and literature review. 

Study Sample and Methodology v * ' \^ 

The present study safnple includes aclentists and tecfinologists in two 

distinctly different work settings ^ industrial and academic. These two 

settings typically require, or result in, distinctly diffetent "styles" of 
' 7 8 

information gathering. * In practically any respect- — use of information 
jchannels, reliance on informal communication, sour ceis or references, and 
library usage—scientists and technologists in these two environments operate 
differently.^ 



5. L. W. Stern, C. S. Craig, A. J. LaGreca, arid R. G. Salem, "The 
Effect of Sociometric Location on the Adoption of an Innovation within a 
University Faculty," Sociology of Education 49 (19 76) :90-96. 

i6. Lawrence, op. cit . 
7. J. S. Gilmore, W. S. Gould, Tb Browne, C. von E. Bickert, and 
I .C. Coddington, "The Channels of Techi^ogy Acquisition £n Commercial 
Firms and the NASA Dissemination Program," NASA Report CR-790 (1967). 

8. D.. N. Wood and D. R. L. Hamilton, "The Information Requirements of 
Mechanical Engineers — Report on a Recent Survey," Library Association (1967). 

9. D. N. Wood, "User Studies: A Review' of Literature from 1966 to 
1970," AiSL-IB Proceedings 23 (1971):ll-23. 



In the Industrial setting, a large facility of an International chemistry- 
oriented firm, 262 scientists and technologl8|||vere Identified as potential 
users of an online search service and completed questionnaires prior to the 
-lRtrodu€tlon-af-8uch-a-Bearch servtcev — Of^he-partlclpant8^98"percerit 



had completed a college education and approximately one-^thlrd (32 percent) 
- held a doctprate. Three-fifths were trained In a field of chemistry, and 
" one-fifth In engineering. One-fourth (26 percent) were Identified ^as super- 
visory, personnel, and the remainder as non-supervisory. 

A total of 70 academic chemists were- fZlentlfled as potential users 
of an online search service and completed questionnaires prior to the introduc- 
tion of such a search service. Of the participants^ 57 percent held the 
doctorate. More than one-third (36 percent) were faculty members, 37 percent 
were advanced doctoral students, and the remainder wre research asscociates 
or postdoctoral fellows. 

Prior to thie intrxjduction of online services, a pretreatment smrvey 
instrument was completed by all participants. This Instrument waa designed 
to assess personal background and work histories, recent and present job 
requirements and related methods of information search and preference, and 
prior experience with online bibliographic search services, if any. Mediated 
online search service capability was then Introduced in a location conveniently 
accessible to members of both samples. Searches were conducted on request 
and free of charge by trained information specialists for approximately one 
year in each location. During this phase 345 searches were conducted for 
108 out of the 262 ellgl^e industrial scientists and technologists; 353 
searches were conducted for 50 out of the 70 eligible academic chemists. 

®^^P ^^ove research base, the present analyses focus on two 
questions.^ First, are there some demographic and background variables, 
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measures of Information "styles" and needs, and data on prior online search 
service or evalua^on which are clearly related, to subsequent use of online 
search services when a relatively hei:erogfineous cross-sec.tlon of scientists and/ 
__l:echiu,logl8t8-|ti-g±ven-the-opp9rtunilrrfor-gen-e^^^^^^^ 

and froe access to such a capability? 

t 

Our second question Is whether - these relationships are relatively stable 
within different environments. Despite the distinctly different "character" 
of these two settings, are there repUcable similarities In traits of • 
scientists. and technologlstF which allow. us to predict, regardless of work 
setting, who will most likely seek tq use online search services If they 

are made available?^ ^' i ■ • 

■ .'•■•>' 

To address these questions, we ulsed two distinct' research strategies. s 
The fli^t was basically a descrlptlvej bivarlate analysis of common Itims 
ol Information collected from sample subjects In both the academic and v 
the Industrial s^ettlngs. Included are three sets of data: (1) . demographic 
(age, sex), prdfesslonal training (degree level and field of formal 
Ing), and present professional position; (2) established lnformat±^"styles' 
and appraisal of adequacy of Informational resources; and (3) p/or online 
search service use and evaluation. 

The second ^lalysls employed a multivariate procedure which allows 
all statistically significant predictor variables, to enter a regression 
equation where the criterion (dlchotomous dummy variable) is subsequent use 
or nonuse of the online bibliographic search service. This procedure enters 
the primary predictors, in stepwise fashion, from the full array of variables 
considered in the first analysis. Hence, these variables are Independent 
predictors, taking into account the collnearlty between variables (e.g., the 
relationship between age, "degree level, and present position or rank). 
Results . ' / 

A'Vrge number of common items, assessed for both the industrial and 



_ academic personnel prior to introduction of online search services, was 
collected. Analysis of these items is presented below, and, as noted 
above, one objective is to ascertain whether the observed relationship, if 

_aa3t*_bet»eeA-these-i"tems-and subsequent-ttse-oi^nllne-ffearch-services 

Is paralleled in both the industrial and the* academic setting. 
Background Characteristics , 

Selected demographic and professional background characteristics 
of the sample, as these factors relate to subsequent use or ponuse of 
online search services, is shown in Table 2. (See Page 50.) 

While the sample Includes relatively few women In either tifee industrial 

' -r - 

or the academic setting, it would appear that this factor is generally 
unrelated to subsequent use of online services. *0n the other hand, consistent 
with the speculation by Curtis^^ that online search systems would be most 
heavily used by junior scientists, age is highly related to use, with older 
persons In either setting least likely to become oisers. ^ 

Not surprisingly, degree level is li^cewise found to be highly related 
to subsequent use of online search services. Fully two-thirds of the doctorate- 
holders, but less than one-third of ^^those h'-lding a degree below this level, 
us€?d the service in the industrial setting. The relationship In the academic 
setting is less pronounced, but the doctorate holders and those with less 
than a Master's (most' of whom are advanced level doctoral students who by-pas^ 
the Master's degree) are more likely than others to be users. 

Of course, somfe of these foregoing variables, particularly the age and 
degree level, are related to one's present position. , Hence, it is consistent 
to nbte that supervisory personnel in the industrial setting are less likely 
than others to be users. In the academic setting,^ the most senior faculty 



10. Curtis, o£. clt.. 
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TABLE 2 

*f. ■ 

Background Characteristics of First Year Users 
of Online Search Services, by Job Setting 



-Industrla3r 



"Academic" 



Total 
cN-262 



Percent 
Users 



Total 
N-70 



Percent 
Users 



Year of Birth* 
Before 1930 
1930-39 

1940 or later • 



80 
92 
84 



33.7% 

40.2 

50.0 



12 
8 
49 



50. OZ 

87.5 

75.6' 



Sex* 
. Male 
Female 



256 
5 



41.0 
60.0 



61 
9 



72.1 
77.8 



Degree Level* 
Doctorate 
Master's 

Less than -Master's 

Field of Highest Degree 
Engineering 
Chemistry (All) 
Organic Chemistry 
Chemical Engineers 
Other Chemistry 
All Other Fields 

Present Position * 
Supervisory 
Non-superyis ory 
Full Professor 
Other faculty 
Fellow 

Doctoral student 
Other 



84 
58 
120 



66 
156 
20 
61 
75 
29 



68 
194 



66.6 
31.0 
28.3 



24.3 
45.5 
80.0 
31.1 
48.0 
51.8 



33.8 
43.8 



42 
7 
21 



67 
■ 8 

59 
3 



15 
10 
4 
26 
15 



72.8 
57.2 
76.2 



71.7 
62.5 

72.9 
100.0 



66.7 
80.0 
75.0 
81.8 
60.0 



*lExcludes no response. 



(fall professors) and those deslgnajted as "other" (primarily research 
associates) are less likely to be, users than are faciaty of other ranks^ 
<foctox£l stu^eribts, and post-doctoral fellows. 

«^ven-:that~the— d'tia^inc \ 7 

focused on chemical liter^ature, it is not surprising that those trained 
as engineers (and chemical e'fegineers) were somewhat less likely than others 
to be users. However, in both settings those trained outside of the area^ '-^ 
of chemistry and engineering were somewhat more likely to be users / alth'dugh 

^ ., . * 

their numbers were small. Within subspecialties of the chemistry field, 1^ » 

, ^- .'.V . . ' \'- ■ ^ ■ ^ ^' ^. 
there would appear to be no consistent patterns, between th^^tWo settings ^ 

Of greater or lesser usage by som^ specialists than by othArdV ^ " ' 

' . ■ ■ - v.. ' ^ ■ * ^ . * < 

'. ''■■•«,'■» ' ■ ' ^ 
Information Style ■ V ^ ^ ^ , . 

■ r ' ' ''^ ■ • 

A number of common items pri' irifoOTatlon needs'^ ^^^l^lSLi appraisal f " 



of their utility were asked c/f all m^befp of l^ot!^t;he ^Ipdu/trial and acad^c 
samples. The relationships between the^e rpffjijMa^^ subiaeque&^mse or , 
nonuse of the online ^earc^i servit:efi ^whlrf^g^ &Kown* 



in Table 2. CSee Page 52-53.> . \ . ^ ' 4- 

■ v^'-vy % 

Our general working hypothesis for ttiese data was th'at -^clear relatflbnsbips\ 

would emerge between these varla_^les Md /ubsequcitt useVbf \ " 7 

services?, and that these telatlpnships wojcSi*:^ cpjpslstent between wof^ I 

environments.. However, fdr mo^- of tKese- relationship' we not fi^pathesfze 

. ^ - . . ^ . ^ ■■ 

the direction o^ ti>e reiatfotishipi^co^s|stepti vlth oirf generally expdtbiTaforjr- 

objectives of the project. - T?!iat ia^t was assumed^th^ the^ airiouht^j^'^^^^ 

one spent in informatlQn-9,eeking, the ik^feds employed,^ would^-clea^ly 



relate to subsequec^t use of onlliie.bibUpgfaphW services'. If ti^eu 

need for informAtjOn was high, ttiteh oue might .pxpfitet; the iferson to more>^ 
generally employ/ online searcJi eerviro^fi^^^e ^qual.v :^^ 

the other haitid, if present "^ratliVQ^ral^ miKs ^feVofteii employed, ai«^ 
there is general strong satisfaction with theseij^^ there -may be less 



• • TABLE 3 

/ Prior Information Styles of First 

Year Users qf Online Search Services, by Job Setting 



Industrial 



Total 
N 



Percent 
Users 



Academic 



Total 
N 



Percent 
Users 



jr. 



i ' '■ 



' Time per week locating Information * 
■ Four hours or less 
More than f ous. hours ^ 

•i !rime per week In reading 
professional llteratttre* . 
' Four hbors or less 
Mlore than four hours 

■■ Time per w6ek In dlscusalon 
jtt^h cblljieagues * 
Four hotirs or less 



'4k^,*Mor§' .than four hours 



.Use of; owif 



ollectlon of 



t ... 



info rma t Ion 
"tjccaslohally or less 
' Frequently > 
Rbutlnfely 

. f ■ ■ ■ ■ 

USae' of Ittei-ature Indexes * 

Never' * '■ 

Seldom, ojf occasionally 
- Frfequjejitlly or routinely 



138 
107 



120 
"133 



101 
151 



28 
46 
188 



45 
138 
78 



42. 8Z 
40.2 



32.5 
49.6 



47.5 
38.4 



35.7 
45.7 
41.0 



24.4 
39.9 
52.6 



44 
23 



27 
42 



10 
11 
48 



7 
17 
34 



68.2% 
82.5 



74.1 
73.8 




70.0 
73.6 
75»0 



71.4 
47.1 
76.5 



* V." 



Use-^of stand.ard abstracts / 
' contents * • ~ 
' Seldom or never 
■ Occ^lonally 
. ; Frequently or routinely 

. ^ Use vbf sfcanning primary 
sources * 

Occasionally or less 
, ■ FrlSquently 
; ■ * Routinely 

* V. ■ / ■ . 

» ! | u^ of llibrary browsing * 
\-.;Sfeldqm or never 



: /Occaaionally 

-i'F: ^ 



IjequeiVtly or routinely 



131 
63 
65 



111 
63 
88 



54 
79 
129 



32.1 
41.3 
58.5 



24.3 
42.9 
61.4 



20.4 

2 
2 



ill 



13 
14 
41 



IB 
38 



18 
17 
34 



77.0 
64.3 
/ 73.2 



61.6 
61.2 
B1.6 



72.3 
82.4 
67.7 
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TABLE 3 (continued). 



Industrial 



-Total 



N 



-Eercent- 



Users 



Academic 



-Total 
N 



-P:ercent 
Users 



Use of citations In other 
works* 

Occasionally or less 

Frequently 

Routinely 

Present means of locating 
Information Is adequate * 
Agree strongly or somewhat 
Disagree strongly or somewhat 

Present sources are adequate * 
Agree strongly or somewhat 
Disagree strongly or somewhat 

Present sources too time- 
consuming to locate* 

Agree strongly or somewhat 
Disagree strongly or somewhat 

Present sources are up-to-date* 
Agree strongly or somewhat t>r 
Disagree strongly or somewhat 



166 


31.3 


17 


47.1 


51 


52.9 


24 


7s n / ' 


44 


63.6 


27 


89.9 ^ 












• 






164 


39.6 


42 


66.7 


93 


44.1 


28 


82.2 


210 


43.3 


54 


68^3^ 


49 


34.7 


16 


87.5 


85 


41.2 


35 


82.9 


164 • 


42.1 


31 


64.6 ^ 


213 


43.2 


53 


69.9 


38 


34.2 


16 


81.3 



^Excludes no response 
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likelihood to turn to the new . Innovative iDeahs of online search services. 

' ■ \ ' ' ' ■ ■ 

The descriptive data shown In Table 3 genet^ly contribute to a continua- 
tion of this ambiguity on the relationship between Information style and 
^sequM 

for example, required the respondents to report on ;the average, number of 
hours per week spent In Information-seeking activities. Including reading 
or professional literature and discussions wlth^colieagues or co-workers. : 
Only small relationships between these time measufes and subsequent use of 
online search Services were observed, and patterns were not repllcable between 
the Industrial and the academic settings. 

For industrial scientists and technologists, those vwho more frequently 
or routinely employed their own collection of Information, literature Indexes, 
standard abstracts or current contents, and library browsing were mdre 
likely to be users of online search services. However, parallel relationships 
for those In academic settings were not observed for these variables. On 
the other hand. In both settings, those who most often used citations In 
other w^ks and who scanned primary sources routinely were substantially ' 
more likely than others to also use online search services. ^ 

Wide discrepancies between the academic and Industrial personnel were 
likewise observed with regard to their perceptions of the adequacy of 
current means and sources for Information as these related to using online 
search services. While those In both groups who felt their current means 
of locating Information were Inadequate were more likely to-be users of 
online search services. In academic settings those who felt present sources 
were Inadequate, that they were too time-consuming to locate, or that they 
were not sufficiently up-to-date were more likely to^H^come users, while 
the reverse was true for these Items for those In Industrial settings. 
Prior Online Experience 

In Table 4, we present data on both prior experience and appraisal' of 



online services with subsequent use of the service when It was Introduced 

In the Industrial and the academic settings. Not surprisingly, those In 

the industrial setting who had used online services in tfie past, or were 

f ainiliarr~wltTr t^ 

r . • 

to use the service. However, for those in the academic setting, there was 

no clear relationship between prior use or familiarity and subsequent use. 

> 

For academics, therefore, this may reflect prior negative (or neutral) Impact 
of earlier use, or it may merely reflect that those who were former lisers of 
online services continued using their former vendor rather than taking 
advantage of the project service instituted for this study. Subsequent 
repotts will more directly address questions of these alternative explana- 
tions. O ' 

The data in Table 4 (see Page 56) clearly show that a more positive 
attitude toward the potential utility of online services results, in more 
frequently taking advantage of the availability of online search services 
when such search services are introduced into the work setting. Substantially 
larger proportions of those who expressed a clear belief that the online i 
service wo^ld Improve ^j^tfi^ current information-seeking methods, on the^ 
basis of what they had learned prior to the actual introduction pf biil^^ne 
search services in their work location, were likely to become usees' ovjer the 
next year. Similarly, those who expressed generally positive comments to 
an open-ended question regarding their comments In the potential utility of^ 
an online search system to their work were substantially more llkel;^ than 
others to consequently become users of the system. 
Multivariate Analysis ^ 

Given the high interrelatlotiship between a number of these correlates of 
use of online search services, the next step was to employ a procedure which 
would select those factors which have an Independent significant relationship 
with use or nonuse of online services. For each predictor variable listed in 



. ' TABLE 4 

. 0^- . ' 

Prior Online Search Service Use and Evaluation 
As Related to Current Use of Online 
M: Search Servl^jes, by Job Setting 



Industrial 



Academic . 



Total 



Percent Total 



Percent ' 





N 


Users 


N 


Users 


Ever previously use online 
services* 
Yes 

No, but familiar w/servlce 
No, af(d not familiar w/ 
service 


32 
75 

152 


■ r 

/ 

56.2% 
44.0 

o 37.5 


17 
26 

27 


(A. 17, 
80.8 

70.4 



Frequency of use of online 
services In prior ygf'ar* 

Never - ^ , 
! Seldom , 
I Occasionally or more 
j ■ '• ' ' * 

Use of online service thought 
^. Improve jcurrent method* 

,^ No/don't know 

Other comments re online 
services * 

Generally positive 

Generally negative 

Other 



242 
16 
4 



104 
154 



117 
15 
56 



V 



39.7 
50.0 
100.0 



54.8 
33.2 



48.7 
13.3 
42.9 



57 
3 
8 



41 
28 



31 
2 
16 



73.7 
66.7 
75.0 



80.5 
64.3 



•83.9 
50.0 
68.8 



*Excludes no response 



Tables 2 through 4, the detailed (uncategorlzed) data (or a qerles of dummy 
variables) were employed for regression purposes. All statistically signifi- 
cant varlablies were allowed to enter freely. In stepwise fashion, as predictors 
of the criterion measure (use or nonuse) . Analyses were conducted separately ' 
by work setting, and the results are summarized In Table 5, (See Page 57.) 

In neither the academic nor the Industrial setting were there many variables 
that entered the regression equation as slgnlflc^t Independent predictors of 
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• , TABLE 5 , 
. . • 'I ■■ . -i 
Significant Independent Predictors of Use or Nonuse 
of Online j Search Services Based on Stepwise 
Multiple Regression Procedures 
by Job S etting ■ : 



Job Setting/Variable 



zero- '1. 
order 
r 



;§^ep 
at 
,^ntry 



Increase F value 
°j in In final 
' R equation 



Indus trj.al 

Frequency of scanning 

primary sources 
Highest degree: doctorate 
Online thought to Improve 
current method 

Academic - 

Frequency of use of 

citations In other 
works 

Present sources thought 
to be Inadequate 



.35 
.36 
.22 

/ 



.40 

.27 



1 
2 
3 



.35 
.4'4 
.46 



.13 
.07 

.02 



24.1 
20.1 
15.1 



1 
2 



.40 

.49 



.16 
.07 



6.8 
5.4 



use of online search services. Moreover, different variables entered the 
regression equation for each of the two settings.' In the Industrial setting, 
the first predictor was a measure of prior Information style (frequency of 
scanning primary sources) y followed by degree level (dq.ctoirate or not) and 
favorable attitude to online services prior to project Introduction of the 
service. The resulting multiple R Is .46. For the academic setting, only 
two variables entered the equation, yielding a multiple R of .49. The first 
was another measure of prior Informatloiji style (frequency of use of citations 
in others works), followed by a measure 1 of dissatisfaction In available I 
Information resources prior: to the Introduction of bfrllrie services. 
Conclusion 

Despite a broad array of data on personal and professional background, 
established Information styles and appraisal of adequacy of Information 
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resourcep, and measures of prior attitude* and experience with online search 
services; the analysis of correlates of who would and who would not use 

online search services yielded relatively .low predictive power. Moreover, 

^^<^h-eWWs7TlttIe^ilia^^^ 

6ne settlng^Cindus trial or academic) and the correlates in the other 
setting. In neither setting, bas4d on a multiple' regress ion model, could 
as much a^ 25 percent of the variancte (R^) be explained in subsequent use 
or nonuse of the online bibliographic search service. Hence, these results ' 
tend ty:bnfinn the earlier findings of both Curt is and Stem, et. al.l2 
regarding generally negligible differences between users and nonusers of 
computer-readable bibliographic data bases, either online or batch. 
• Nevertheless, in broad terms, these results do suggest that prior 
information "style," satisfaction with more traditional information resources, 
and attitudinal predisposition to the possible utility bf online search 
services, have some small effect on subsequent usage of online services. 
In later sections, we evaluate these same factors as they might imjiact on 
the frequency and ^type of use of online search services. ^ 

Early Versus Late Users 

« ■ ' ■ i ' 

We now look at a subsample pf early and late users to address the same 

policy considerations as for users versus non-users. That is, can we 

identify distinguishing characterisTics of late users In order to develop 

targeted prSgraaa of education to bring these late users .in to use a 

search service sooner if Tt is appropriate to their needs? 

Sa^iple and Methodology 



Of the 108 industrial users, 62 (57.4Z) used the online search services 
within the first three months that the system was made available. These 



11. Curtis, o£. Qlt . 

12. Stern, o£. cit . 



are. identified as early us&rs . Of the academic chemists, 29 of the 51 
users (56, 9S:) were likewise early users. ° u 

The first set of analyses relates selected items or questionnaire data 



to wheBTer-tWuser was "iST^arly ii^"e""r' , (conducted a~^ear7h ^ithin~thi~ flr^ 
three months after the online services were introduced)* or came in for' 
his/her first search request at, some later time (late user) . Basic 'des-" 
- criptive statistics, by user type (early and late) are presented foj- all 

factors employed in the earlier analyses on -tisers'^ and noriCiser; viz' . selected 
demogtaphic and background variables, measures of 'information "styles'/ and ' 
information needs, and data^on prior online sfearch servide use ind evaluation. 

The second set of analyses is based on a. multivariate procedure which 
allows all primary predictor variables to enter a regression equation where 
the criterion variable is a continuous measure based on the project lionth of : 
first use of the onlin^ search 'services . This procedure enters the lirimary 
predictors, in stepwise fashion, from the.full array of variables considered 
In the first analysis, and shows the amount of Increase ^In explained 
on the criterion measure (mbnth^ of first use) for each step. 
' Results ^ - ^: > . V ' 

^ A large, number of common items, assessed for both the industrial and 
academic personnel prior -to introduction of a year of free online search ' 
services, was collected. Analyaes of, these Items are presented below and , 
emphasis Is placed on determining those Items which may be the best pjre- ' 
dlctors of early use and to assess whether thes^ same predictors are consist 
tent across settings. ' 

Background Characteristics ' 

< ■ ~ , ' ■ 

Selected demographic and background characteristics of users of tjie - 
online service, as these factors relate/to whether the user was, early (first 
three months) or late (after the firs^ three months) in availing themselves 
of the services, are shown in fable 6. (See Page .60.) - 



variance 



60 



tab£e 6 

c. 

Background CharacterlBtlcs of Early** Users of 
Online Seardh Services, by Job Setting 



Industrial 



Total 

Number 

of 

Users 



Percent 

Early 

Users 



Academic 



Total Percent 

Number Early 

of Users 
Users 



Year of Birth* 
Before 1930 
^ 1930-39 
1940 or later 

Sex* 

Male ' 
Female , 

Degree Level* 
Doctorate 
Master's 

Less than Master's 

Field of Highest Degree * 

Engiffeering 

Chemistry (All) 

drganic Chemistry 
Chemical Engineers 
Other themistry 

All Other Fields 

Present Position * 
Supervisory 
Non-supervisory. 
Full Professor 
Other faculty 
Fellow . 

Doctoral student * 
Other 



27 


55.5%' 


7 


71. 4Z 


37 


56.7 


7 


71.4 


42 


61.9- 


37 


78.4 


105 


57.1 


44 


77.3 


3 


66.7 


7 


71.4 


56 


62.5 


31 


71.0, 


18 


61.1 


4 


75.0 


34 ' 


47.1 


16 


87.5 


16 . 


37.5 






71 


60.6 


48 ' 


77.1 


16 


62.5 


5 


60.0 


19 


73.7 






36 


52.8 " 


43 


79.1 


15 


66.7 


3 


66.7 



23 
85 



56.5 
57.6 



10 
8 
3 

21 
9 



80.0 
-37.5 
100.0 
85.7 
77.8 



♦Excludes^ no response. ' . . " 

**Early users are defined as those- using the service In the first three months. 



ERIC 



fi9 



are 



Inasmuch as the sample Includes relatively few women, It Is not 
possible to draw any cpncluslon regarding sex differences between early 
and late users. Regarding, age. . however . the data surest that not only 
older faculty not as likely to use online services (as described elsewhere 
^ m this report), but they also are less likely to attempt to employ online 
services when first Introduced even when they do eventually becom/ users. 

In the Industrial setting, those with post-4^cd$.aureate defrrees are 
more likely than others to be early users. Amonrthe academic users, however, 
those without yet having a graduate degree are more likely to be early 
users. Indicating that Itudents In particular are likely to be * experlmeiirive 
In attemptln8ne^,J>«f«^ search techniques. Indeed, the'^esults show 
that facul^^ow the full professor rank are substantially slower to adopt 
use of the online search services than are those, In any other category, desivite 
the fact that these faculty persons are generally more likely than others to 
be eventual users. In contrast, among the Industrial users there Is a 
negligible difference between supervisory and nonsuplrvlsory personafel In 
their likelihood of being early users. Nor are there clearcutr differences 
''^''^^^"''^^"^^^"^^ ^" chemistry, repllcable across both work settings. 

^"8gest that scientists and technologl/^^Tln some aspects of 
chemlstHr were more likely than others to be early-^s 
Information Style 

A number of common Items on Information needi'. habTTs. an'd appraisal of 
their utility were asked of all Industrial and acadlLlc online search ^serylce 
users "prior to the Introduction of the servldes. The relationships between 
these data and subsequent eaily or late use of the service are shown In 
Table 7. (See Pa«es 62-63.) ' 

Surprisingly, for approximately two-thirds of the Items shown .In Table 2, 
the general relationship with early vs. late use Is not In a cc||.is tent direction' 
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TABLE 7 



Prior Information Styles of Early** 
Users pf Online Search Services ^« by Job Setting 



Industrial 
Total Percent 
Number Early 
of Users Users * 



Academic _^ 

Tot^il Percent 
Nuniber Early 
of Users Users 



Time per week locating 
Information * 
Four hours or less 
More than four hours 

Time per week in reading 
professional literature* 
Four hours or less 
More^than four hours 

Time per week In discussion 

vith colleagues* 

Four hours or less 
More than four hours 



59 
43 



39 
66 



48 
58 



62. 7Z 
51.2 



59.0 
56.1 



60.4 
53.4 



30 
19 



20 
31 



26 
25 



70.0% 
84.2 



75.0 
77.4 



73.1 
80.0 



Use of ovn collection of > 
Information* , 

Gccaslanally or less 

Frequently 

Routinely 



10 
21 
77 



60.0 
61.9 
55.8 



7 
7 
36 



100.0 
85.7 
69.4 



Use of literature Indexes * 
Never- 

„_Seldom or occasionally 
^jPrequently or routinely 

: \ V " •• 

Us^^i^R^ifeandard abiil^tracts/ 




: ^Occ^sldnally • 
^^quently or routinely/- 



Use scannfinig Rrlma 
8o3rces"* 



Occasionally oi; leaia' j 
Frequently «• .•• 
Routinely 



11 
55 
41 



42 
26 
38 



27 
27 
54 



ai.8 

54.5 
53.7 



59.5 
53.8 
55.3 



48.1 - 

51.8 

64.8 



5 
18 
26 



10 
9 
30 



8 
11 
31 



60.0 
66.7 
88.5 



50.0 
88.9 
83.3 



75.0 
81.8 
74.2 



TABLE 7 (continued) 

^ 



Industrial 



Total Percent 
Number Early 
of Users Users 



Academic 



Total Percent 
Number Early 
of Users Users 



Use cxf library browalnf^ * 
Seldom or never 
Occasionally 
Frequently or routinely 

Use of citations In other 

works * 

OccMion^ly or less 
Frequ^lfily ^ 
: <• Routinely ^ 



-4' 



Present means of locatln f ^ 
Information Is adequate* 



\ 



Agree strongly or somewhV. 
Disagree strongly or somewhat 
«^ 

Present sources are adequate * 
Agree strongly or somewhat 
Disagree strongly or somewhat 

Present sources too time - 
consuming to locate * 

Agree strongly or somewhat 
Disagree strongly or somewhat 

Present source's are up-to-datfe * ^ 
Agree strongly or somewhat 
Disagree strongly or somewhat 



11 
31 
66 



52 
27 
28 



65 
41 



91 
16 



35 
69 



92 
13 



45.4% 

54.8 

60.6 



53.8' 

63.0 

60.7 



53.8 
61.0 



56.0 

62.5.V 



54.3 
59.4 



59.8- 
38.5 



13 
14 
23 



8 
18 
24 



28 
23 



37 
14 



29 
20 



37 
13 



84. 6X 

71.4 

73.9 



75.0 
88.9 
66.7 



75.0 
78.3 



78.4 
71.4 



86.2 
65.0 



81.1 
61.5 



*Exclude8 no response. 

**Early users are defined as those using the service In the first three months. 



across the industrial and academic settings. To the extent we are 
seeking generalizations regarding the characterlstlcs#of early and late 
users, these reversals In relationships across settings suggest null results 
as pertains » most Items on prior Information styles. For example. In the 
Industrlaajl^^ttlng, those users who devote somewhat less time per week to 
locating Information, reading professional literature, and engaging in pro- 
fessional discussion with colleagues are somewhat mor^ likely to be early 
users of online search services^ In comp^^;^n, among academic users, those 
more frequently engaged In these activities are also somewhat more likely to 
be early users. 

For both academic and Industrial technologists, those users who most 
. frequently employ their own collection of Information are less likely to be 
early users of online search services. However, unlike the academic chemists, 
the most probable early users in the industrial setting are those who do not 
use literature Indexes, rarely use standard abstracts, and more frequently 
scan primary sources, engage in general library browsing, and frequently employ 
citations In other works. 

In both settings, those who Indicate that their present means of locating • 
Information Is less than adequate ar^ slightly more likely to be early users 
of the online system. However, both the academic and industrial users who 
believe that their present resources are up-to-date are more likely than others 
to be early users. Amoqg the industrial scientists and technologists, those 
who report that present sources are Inadequate, but are nevertheless not too 
time-consuming to locate are slightly more likely to be early users. For the 
academic chemists, the reverse Is true, with those believing that the present 
sources are adequate but too time-consuming to locate beliig more frequently 
early users of online services. 

Prior Online Experience ' . 

< 

In contract to the foregoing, there Is substantial consistency between 



Industrial and academic users regarding prl^r familiarity and ^^ppraia^^ 
oflllne search services £uid subsequent early use '0f such* teeifv*cQ5, »H<eh ltitro-,'^-V ! • 
^duced on a free basis In the respective wqrk settj|S.njgsv . These retl^tifonshlps 

are shown In Table 8. (See Page 67,) ' : * . . .> X , ' 

t , , . . . " ' 

Clearly, those users who had at some ^arller point la th'ej.r. careeVused 
online services were more likely to be early users when they again had an 
opportunity to access online searching. Of the 18 first-year users of the 
project services In' the Industrial setting who had previously used online 
services, two-thirds were early users; of the 11 experienced academic users 
who used the project services, 90 percent were early users. Not surprisingly, 
for^both experienced and non-experienced online users, those who thought online 
^ searching would be an Imjirovement over their current methods of literature ^ 
searching, and who otherwise were not negatlvje about online searching 
capability, were also somewhat more likely to be early users of the project 
services. ; x 

Multivariate. Analyses 

In the second analytical phase, each predictor variable (uncategorlzed) 
^listed in Tables 6 through 8 was\egressed on the dependent variable, recoded 
as a continuous variable based on the projecj^ month of first use of the 
online search service. All analyses were conducted separately by work setting, 
and the results are summarized ln\Table 9. (See Page 68.) ; 

'1 A ' 

In the Industrial setting, noi^e of the predictors reach >b tat 1st leal 
^Ignificance. Nevertheless, the first three vaflables to enter the multlvarlagje. 
. equation are reported in the Table and, in combination, are shown to predict 
only a trivial six- percent of the variajice in the criterion variable 
(project m^nth of first use). 

For the users in the academic setting, only slightly better predictive 
resu^s are obtained. The first three predictors to enter the stepwise 
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TABLE 8 



Prior Online Search Service Use and Evaluation 
As Related to Early** Use of Online 
f Search Services, by Job Setting 



Industrial 



Total Percent 
Number Early 
of Users Users 



Academic 



Total Percent 
Number Early 
of Users Users 



Ever previously use online 
services* 



Yes 




18 


66. 7Z 


11 


90.0% 


No, 


but familiar w/servlce 


33 


63.6 


21 


71.4 


No, 


and not familiar w/servlce 


57/ 


50.9 


19 


73.7 



Frequency of use of online 
gc^rvices in prior year* 



Never « 


96 


■56.2 


42 


73. 


8 


Seldom 


8 


50.0 


2 


100. 


0 


Occasionally or more 


• 4 


100.0 


6 


83. 


3 



Use of cmline service thought 
to improVe current method* 
cr^^Yes 

No/do^'t know 

Other comments re online 
services* 

Gener allyjpos i t i ve 

Generally ^negative 

Other 



57 
51 




63.2 


33 


81.8 


51.0 


18 


66.7 


59.6 


26 


73.1 


50.0 


1 , 


0.0 


70.8 


11 


72.7, 



* Excludes no response. 
** Early users are defined as those--iising the service in the first three months 

I Q 

multivariate regression are again shown, although only the first reaches sta- 
tist^^^al significance. That is, the only statistically significant predi/tdr 
of njjbnth of furst use among project users is academic rank, with assistant and 
associate professors least likely to be early users. 
Conclusion , . . 

A broad array of factors; including personal and professional background, 
established information style, appraisal of adequacy of information 
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TABLE 9 'V^^ 

, T ; 

Primary Predictors of Month of First Use 
of Online Search Services, Based on 
Stepwise Multiple Regression 
Procedures, by Job Setting 




zero- 



Job Setting/Variable order aP ' ' R ; " r2 

r entry 



. „ ^ : o level of 

« sighifi- 



cance 



J2L 



Industrial 

Frequency of use of 
literature indexes .16 

Frequency of use ofv ^ 
^ ^citations r -.10 

Present sources thought ^ t 
to be up-tordate ^ .13 

Academic .yP^^d^' ^ f 

Present positlpn faculty, 
not fij.1 professor .42 

Frequency of use of 
literature indexes -.23 

Frequency of ua^ of 
citations "^^^ .19^ 









9 




.16 


.02 


■-■'Iris. 


•2 


.22 
















.26 


.06' ^ 


rr;s. 












.42 J 


.18 

* a 












2 " 


.48 ' 


.23 




#■ 

3 ■ 






. NiS. 













1 

9 







weVe generally found to be inconsequer^tial%redict^rs of who woul^ use onlifte'^ 
services early and who would use them later. Adeed, evea^inor, stafisticalf^ 
Insignificant, relationships were frequently foarrf to not be replicable 
between industyfial-an^ academic' setting , further confirming the lack of 
predictability as # when userd. might seek online search services. 

-ef course^, these null results cannot br generalized beyond the particular 
^^^T A^^*"^"""*^ questioris analyzed here.^or to differ4nt types of 
populations than -the two type^ of settings (industrial and academic departments) 

• . - . k 



68 



we analyze here. Other variables, such as type of job task responsibilities 
and stage of work in one's research project(s), inightH^ell be expected to 
determine when one might seek the capabilities of an online search service. 

Nevertheless, in broad terms, these results suggest that we cannot 
adequately predict whi|^ users are i^re hesitant and which are early adaptors 
of online search services. In ge^ier^ the same predictors employed here 
are likewise weak predictors of who will, and who wtll not, seek any use what- 
soever of online search services. 

In conclusion, these results provide little encouragement to the d^ 
-^ignttig of targeted programs, based on the factors reported here, to bring 
^ii-users and late users .into early exposure and adoption of general use of 
ooline search services. These results do, however , demonstrate high pro- 
portionate use, and general early use, offline search services by the 
general community of academic and industrial scientists and technologists when 
such services are free, well staffed and located in dire_ct proximity to the 
work environment • As noted later, this general endorsement of the service 
as reflected through usage rates is sustained after cost factors 
duced and information specialist assistance is curtailed, as 
the fact that both the industrial and academic units continued po offer ori^ 
line search services after this research project was terminated. 
Frequency of^ Use 

This^4^ection, employing the same common set ^of predictor varl'ables, 
analyzes the relationships between these; variables and frequency of use of 
the online search services during the first year of the project (i.e.. Phase I) 
The objective of this anlysls is to ascertain yhether these factors, determined 
prior to the introduction of online search services, can aid in planning 
the estimated demand for such search services when they are made readily 
available to scleritist^ and t^hnologists in both industrial and in academic 




environments. Indeed^ in setting up the project services for this itudy, 
there was little empirical research avaij^ble to guide decisions on the 

..:.v;>; ■ ■ - \ ■ N 

establishing of the length of time each day ^uring which the services should 

be offered, the number of information .specialists needed, the numbet of 

J ^ ^ ^- . J 

terminals required to service all requests on demand, or how much demand 

\ . *i ' 

would vary .from day-to-day or as a function of the academic calendar in ... 

the case of the academic chemists participating iiP the project (see the ^ 

average 'ciaily usage charts in the appendix reg;,ardirig the latter) .^^llllPi^ 

following analyses attempt to ascert^n the correlates of the frequer/cy 

with which users of online search services will call- upon such services, 

in order that future efforts to establish online search services in similar ^ 

environments might bett^er predict, a priori , the demand for such services 

as related to ascertainable information about potential users prior to 

introduction of the service. ... • 

Sample and Methodology ' 

For the 51 academic chemists who used thie project search services, 

353 bibliographic searches were conducted JLn the first year., an average of 

6.9 searches per user. Only 5 of the 51 (9.8%) v ere singie-time users 

during the year. On the other hand, 9 (17.6%) were' extr^emely heavy users 

\ of the system, conducting 10 or more searches during th^year. 'i^ ^ ' ^ 

A total of 345 searches were conducted for the 108 industrial us^rs 

I during the first year, for an average of 3.2 searches per lA^er. Fully two- 

fifths (41. 9Z) of the 108 usars were single time users only. A. small 

proportion (5.5%), 6 out of the 108 scientists and technologists, were heavy 

users with 10 or more searches during the first year of the project. 

Consistent with previous ^analyses, two distinct research strategies were 

. employed. Th^ first analysis presents basic de&briptive data on frequency 

of use by. each of the three sets of common background date fpr the academic 

Q ' ■ ' 
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and industrial uaers: (1) demographic (agie, sex), professional training 
(degree level and field of formal training), and present professional 
position; (2) established informiation "styles" and appraisal of adequacy 

of infonnat^ional resources; and (S) prior online search service use and 

. j 

evaluation* | 

The second analysis employed a multivariate procedure which allows 

• • ■ • i . ^ • • • 

all statistically significant background variables to enter a predictive 

equation where the "criterion (dependent) variable is the niflnber of 

searches the niser requested' and llad executed during the first year of the 

! ^ ■ j, 

project. This p^cedure was conducted separately for the academic chemists 
and for the industrial scientist! : and technologists. In both cases,* the 

procedure ^elected the primary pijedictors of frequency of use and entered 

i _ ■ . 

them in st4pwise fashion until no additional factors from the full array 
of backgroiind variables could significantly add to the amount of explained 
variance in the ^ependent variabli* 
Results 



Analys 



les of the relationship between each of the common pool of items, 

i ■ 

ascertained prior to the introduction of online bibliographic search services, 
and subsequent frequency of use of the search service, are shown below.;^ All 
analyses are reported separately by work setting (industrial or ^cademicy, 
and one objective is to ascertain the degree to which, the correlates of^-usage 
rates are generallzable across work settings. . * 

Background' Characteristics 

The set of demographi': .^^nd [Professional background charactei^istics of the" 

*' 3^ - ' ' 

users of the online search services, as these characteristics relate to' 

t -. 

the frequency of usage, are shown, for the^cademic chemists in "t'able 10 and 
for th^ industrial scientists and technologists ;in Tay.e 11. (See Page9^72 and 
73.)) . - ' - .;- ^ ^ J 



TABLE 10 



Background Characteristics of First Year Users of Online 
Search Services, by Frequency of Use: ^cademlc Setting 



. ■ ■ ■ , . ■ I 

Frequency of Use (Percentages) ! 
Total Single Light Medium Heavy 

Number Time User User User 

of Users User (2-4 (5-9: (lO or 

times) times) more times) 



Year of birth* 

Before 1930 / 1 

: 1930-39 ( 7 

1940 or later . 37 

Sex* 

Male 44 

Female 7 

Degree level * 

Doctorate 31 

Master's 4 

Less' than Master's , 16 

Field of highest degree * 

Chemistry (All) 48 

Organic chemistry 5 

Other chemistry 43 

All other fields 3 

Present position * 

Full Professor 10 
Other faculty * 8 

Fellow 3 

Doctoral student 21 

Other / 9 



0.0% 
28.6 
8.1 



11.4 
0.0 



12v9 
0.0, 
6.2 



10.4 
0.0 

11.6 
0.0 



10.0 
25.0 
0.0 
9.5~ 

0,.0 



57.1% 

'42.9 

37.8 

40.9 
28.6 



38.7 
25.0 
43.8 



35.4 
20.0 
37.2 
100.0 



40.0 
25.0 
66.7 
47.6 
44.4 



42.9% 

0.0 
35.1 



31.8 
42.9 



29.0 
75.0 
31.3 



35.4 
40.0 
34.9 
0.0 



40.0 
25.0 
0.0 
38.1 

33.3/ 



0.0% 
28.6 
18.9 



15.9 
28.6 



19.4 
0.0 
W.7 



18. 

40.0 

16. 

o.b 



10. 
25. 

33.^ 
14.3 
22. i 



7 : 



^Excludes no response. 



i 



80 



72 



TABLE 11 r 

Background Characteristics of First Year Users of Online 
Search Services, by Frequency of Use: Industrial Setting 



Frequency of Use (Percentages) ^ 
Total Single Light Medium Heavy 

Number Time User User User 

of Users User ^ (2-4 (5-9 . (10; or 

times) times) more 

; times) 



Year of birth * 
Before 1930 
1930-39 
1940 or later 

Sex* 
Male 
Female 

Degree level * 
Doctorate 
Master's v. 
Less than Master's 

Field of highest degree * 

Engineering 
^. Chemistry (all) 

Organic chemistry 
Chemical, engineers 
Other chemistry 
All other I fields 

Present position * 
Supervisory ^ 
Non-supervisory 



27 
37 
42 



105 
3 



56 
18 
34 



51.8% 

37.8 

35.7 



41.9 
0.0 



30.4 
27.8 
64.7 



22.2% 

48.6' 

4(1^9 

36.2 
0.0 



35.7 
55.6 
23.5 



25.9% 

5.4 
26.2 



17.1 
66.7 



25. Of. 
VS. 7 
8.8 




16 


56.3 


37.6 


6.2 


0.0 


71 


36.6 


33.8 


22.5 


7.0 


16 


31.3' 


50:0 


18.7 


0.0 


19 


42.1 


21.0 


36.8- 


0.0 


36 


36.1 


33.3 


16.7 


13.9 


15 


46.7 




13.3 


6.7 


23 


34.8 


43.5 ^ 


21.7 


0.0 


85 


42.3 


32.9 


17.6 


7.1 



♦Excludes no response. 



While the samples Include relatively few women (7 users In the academic • 
setting and 3 users in the industrial setting), they were substantially more 
likely thafl the^r male counterparts to be frequent users. None of the users who 
were women used the services only once, and about three-fourths of the' women 
in the academic department and all of the women in the industrial setting 



conducted five or more' searches during the year. ' , ' 

With reijard to a^e, and consistence with earlier findings which show 

that older, scientists and technologist 9re less likely to use online search 
services and to use them later rather than -Sooner after introduction if 

they do become users , older persons are also less likely to Ibeeome heavy 
users of the online computer readable bibliographic seai;ch services, pne .• 
obvious explanation of these consistent findings regarding age is that olSer 
scientists and technologists are more resistant than younger persons to new ^ 

1" ■ *' . - i ^^^^^ 

innovative%echniques for literature searching. H<Sever, an alternative expl 
tion, disciissedJMfeater section of this report, may be that the more senio: 
persons have addlWnal resources and technical assistance availablfe to them 
Which allows th^m to delegate literature searc^hlng to their ^more junior ^ 
associates. " . ' . - 

However , the data in Tables 1 and 2 as ^«tllils to degree level run 
counter to the latter explanation. ^That is, tlje doctor^e holders in the ; 
industrial setting are not only more likely than others to ^_users of online 
.searching but they are also significantly more iikely to be frequent users. 
In the academic netting, there are less clearcut differences in frequ^cy of u, 
by degree level, with n» statistically significant difference among^the 51 . 
users. Similarly, in both settings there are no clear discernible differences 
in the frequency of use as Sr/fbnction of jpne's present position. ^ 

Not Su^rising,. given the data bases available in the project's online 
^searchirfg s|stem, those users whose formal training was outside of chemistry 
tended to be somewhat less frequent users of the system. Among the chemists, 
hoyever, there J^as no consistent pattern of frequency differences between the 
;: industrial , and £jie academic users as related to their area pf specialization 
i-h the field of chemistry. ■ ' . 
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* Informalrtcni StiJ.e ^ ^ - . * 

, ! ^ te, . ^ ^ ^ „ . 

- ^ * Data on thfe frequency of- online^search jise as related" to the Informatioti 

■ ' , > ■ ; • ■ 

ne^ds, habits, and appraisal of the utility of tradltipnal liiformatlon resources 

for the academic and. Inddsttla?! scientists and technologists are shown* In/ "^v 

*■ . • ^ ' " ■ • 

Tables 12 and 13 respectively. (See Pag^s 76-79.) ^ 

Na clear cut pat teriv^i ,replic able across work settings, were found 

between frequency of use^^d the average amount of time thS scientists -and . 

.t^Chndloglsts tfevoted to locating Informatloni to reading |pifOfesQlonal 

literature, and to discussion wlth^colleagues. ^ ' ^ — ^" — * 

Jn both settings, the data suggeat that "those who more frequenti^P^se" 
. ■ . ' 

literature Indexes^. standard abstracts and current contents, and who more 

routinely scan' primary sources and use lllyrary browsing for Informational 

purposes ,*^are also more likely to be^j^fkquent users of online bibliographic ^ 

search capabilities. In contrast , however, among the academics, those who 

moGt frequently use citations* in othejTworks and routinely use their own 

coll*<5^1'on of Information are substantially less likely tb become frequent , 

user^ of online search services, while the. opposite tends- to be true for ' 

» * . ' ■ , . * ' V 

the industrial scfentistb and technologists. ^ ' ' - 

Thedasfc fpur items shown in Tables ^2 and 13 pertain to the evaluation 
ol the adequacy "^of Wist ing Information r§^ource^ as related to. subsequent 
frequency of>u8p of online dear eh services. Again, no conslstent^.^^ttems - 
emerge, generaliz^ble across both the academic. &itd industrial settings, which 
would suggest a^^bug^t relationihlp between tlie amount of usage of online 
Bearch services and the ln^vidu£j/s appraisal "(of the adequacy ^of 'existing ^ 
^ tt|ll^tibiGi^^^ c|pabilimLes in their work environment. 

Prior Online Experience ; ' — ^ , , 



' 'Prior to the introduction, ^of'p^ect online search services In the 
academid and. liwilustrial setting* ,^ ^ a numbSr of the eventual niaers had prl^or 
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TABLE 12 



4r 



Prior Information Styles af First Year Users af Oii 
Search 'Services, by , Frequency of VBe t AcWenitc Setting 



.7- 



.a 



J"- 



Total 

of Users 



• Frequency^bl^ Use- (Percent^ages) 
Single "'rl^^t ; M^<UjmTJ Heavy ' 
. ,<Time - ; 4 'USefc^^ ^ V nl^j^fe User ^ 
User :C2r|?::l^ • ^^H^B'^^^^ 



Time per-^jreek .locating 
I information* ^ 

Four, hours or Jtess^ s^* 
More? t^han four hoti^ 

Time per vieek in reading 
yrofesalonttjl literature* 
' Vjtfuv hours or less 
ifore«'tjtipiT four . hours ^ 



30 
19 



\. • 16.7%^ U ^^!7XV .-> io.OX 

q;o^^|V;«^^^'^:>; 31.6 



4iv 



20 / 

3rl i 



:35.0 
i2.3 



Time per week J.n discussion 
with colleagites* 

Four hours or leds ^ ;i^6 



V ?tore than, f otlr hojjrs 

Use, of dwn collection of 
information*'' ""^^ 




Occasionally or less * 
■ ■ Frequently ■; « 

Routinely ^ 

■• * ■ ■■ "'-J . , . ^ ^-^ 

Use of literature >bdexes * 

• '• Never " ^ * 

• . SeldoiB br occasionally 

. ^Frequently or routinely 

Use of standard attetracts/ v 
contents* 

Seldom t>r never 5 ^)rf^ 

Occasionally 

Frequently or routinely 
- , • . if . 

Use of scanningf primary^ 
sources * " 

Occasionally* or less 

Frequiently' 

Routinely ^ 



26. 7Z 
S.3 



20.0 
16.1 



15.4 
20.0 



i 7 
7 

> 36 

1 V 

# ■ * . 
■ ■ * , 


0.0 


.42.9 
14 . 3^( 
33.3 


28.6 
57.1 
27.8 


28.6 
28.6 
13.9 


5 
1.8' 


20.0,. 
11.1 
, 3.8 ■ 


40.0 

'^53. 3 
46.1' 


40.0 
27.8 
3A.6 


^0.0 
27. B- 
15.4 


10 
9 
30 


20.0 
• -■ 0.0 
6.7 


30.0' 

33.3 

46.7 


50.0 
33.3 
26.7/ 


0.0 
33.3 
20.0 


8 
11 

31 


12.5 
. 0.0,. 
12.9 


•25.0 
. 54.5' 
38.7 • 


. 5a. 0 
. 36.4 
25.8 


"12,5 
. ■ 9.1 
22.6 



- J... 



TABLE 12 (continued) 



Total 
Number 
of Users^ 



. 'Frequency of Use (Percentages) 
/jSlngle - .Light Medium Heavy 



Time 
User 



User 

(2-V, 

tin&s) 



User 
(5-9 
times) 



User 
(10 or 
more 



Use of library tirovsing * 
Seldom or neveif 
^ Occasionally 

Frequentl}^ or routinely 

Use of citations in other 
yofks* ? 

Occasionally or less 

Frequently . 

Routinely 

Present means of locating 
information is adequate* 
Agree st%bngly or some- 
• \i^at 

Disagree strongly or * 
somewhat 

Present sources are 
adequate* 

Agree strongly or some-. 

. what 
Disagree strongly or 
^ somevhat 

Present sources too time- 



consumlng <o ^locat 



Agree strongly or sjon^e- 
What 

>^ Disagree strongly or 
somevhat 

- -J - ■ . 

Present sources are ujp -L 
to»*daCa* r ' ^ 

Agree strong^y^r some- 
what 

'^Dl8#^ree strongly or 
somewhat v 







■d ■* ■■ 










^* ■ 








15.4 


53.*8 


V 15.4 


15.4 


14 


7.1 


35.7 


35.7 


21.4 


23 


8.7 


34.8 


39.1 


17.4 



8 
18 
24 




28 
23 



37 
14 



29 . 
N20 



1?.5 
5.5 
12.5 



'•'7.1 
13.0 



'37.5 
44.4^ 
37,5 



12.5 
38.9 

33.3 



32.1 -39.3 



47.8. 



26.1 



8.1 
14.3 



37.8 
42.9 



35.7 




3.4 

do.o 



44.8: 
30.0 



,34.5 



3b. 0 



37 



8.1 

23.1 



37.8 

146.1 



32.4 
30.8 



37.5 
11.1 
16.7 



21.4 

13tt) 



21.6 
7.1 



17.2 
20.0 



24.3 
0.0 



f 



TABLE 13 

Prior Information Styles of First «iar Users on Online 
Search Services, by Frequency of Use: Industrial Set tin® 



Frequency of Use (Percentages) 
Total Single Light Medium Heavy 

Number Time User User User 

of Users User^ ' (2-^ (5-9 (10 or 

# , A times) times) more 

. [ times) 



Time per week locating 
Information * 
^ Foul^ hours or lesi" 59 
Morfe than four hours 43 

Time per week In Vpadln f^ 
professional literature* ^ 

* Pour hours or less 39 
More than four hours '66 
' , . ^ 
Time per week In dlscusst^bn , 
vl tl^GO lleagues * ~ '■ 

P3ur hours or less 48 
More than ^our ^ours ' 58 



Us e-of-tJvn-corlrlTeex 1 on"o 
Information * 

Occasionally or less 

Frequently 

Itoutlnely 



Use of literature In^xes * 
Never . . 
Seldom or occsijsi^j^^n^ 
Frequently ox^^^lnelg^ 

Use of standard abstractl jf/ 
contents * 

Seldom os never 
- Occasionally 

Frequently or "riutlnely 



Ufae of scanning il^lmary 
sources^ ^ 

: Occasionally or less ^ 
Frequently . ^ 

, Routinely 

■J 



f 



10 
21 
77 



11 
55 

41 



<f2 
26 
38 



27 
27 
54 



3^.0% 
44.2 



5dl4 
33.3 



43.8 
37.9 



50.0 
38.1 

40.2 



9.1 
49.1 
59.0 



52.4 
46.2 
26.3 



48.1 
37.0 
►38-9 



32. 2Z 
34.9 



28.2 
36.4 



29.2 
39.6 



50.0 
28.6 
35.1 



54.5 
34.5 
29.3 



30.9 
23.1 
44.7 



33.3 
37.0 
35.2 



23. 7Z 
13.9 



12.8 
22.7 



0.0 
33.3 
16.-9 



36.4 

12>,7 
21^9 



14.3;P 

23.1 

21.0 



14.8 • 
25.9^ 
16.7 



41; 



5.12 
7.0^ 



2.6 
6.1 



2.1 
8.6 



0.0 
0.0 
7.8 



0.0 

0^9.8 



2.4 

7.7- 
7.9- 



3.7r 
0.0 . 
9.2 ' 

. { 



TABLE 13 (contlnued> 



Total Single 
IRunbex - Time 
of "Users Uset 



Frequency of' Use (Percentagas) 
User. User 



Eight 



Medium^ ^.^^,-'.H^ 

vUser " 

(2-^* (5-9 I f (10 or 

times) times) r more 



■ Use of library browsing* 
: Sel<ioin or^ never , . 
Occasionally 
• -'^ jf'r^qiifcntiy pr. t'6 

'•' ■ ■ J ^t^se"^■ctfe^l&^:. .^ ^lier^ ■ 

>^ •" ■ ;/^rks* J/#.r^-^-iin^ ■.■ 



11 
31 
66 



36.4 
38-7 



45-; 4 

38.7 



4€.4^ 31.8 



18. 2 i 
22.6 
16. 7i 



0.0 
0.0 
9.1 

\ 
! 




^Excludes ^i^espqnse 



7. 



experiieriQi^ and/or pplnlonii with 




onllTie bibliographic searching. 



■^ajr^>e T^ie Mi^^fciio^^ betyeen these factors and subsequent frequency of use 



^-^^^ oni^tie search services ^re 4lriQwn in^ Tables 14 and 15 for the 

'[\'-'-::^^^' ^ca&ea±c and -the industrial scientists and technologists respectively. 



<See belpw and Page 81.) 



TABLE 14 



■ -Trior Online Search Service Use and Evaluation as Related to Current 
^ ; Use of Online Search Services., by Frequency of, Use: Academic Setting 




/X/ 



• Frequency of Use (P.ercentagQ^||^ 
Total Single Light ., i^^^edium . Heavy 

Number Time % Us er • ' User 
of Users ^ User .^J^4 (5-9 (10 or 

; ; ' times times) more 
-.-y- . • ■ ' times) 



l^ver previously use otiline 
: service^* . » 

' ^^^^ .11 . 

No, ^ut familiar w/service 21 
* No, and ndff ami liar ' -.^ 



online 



4 



Frequency of use ' ^^^^^.^ 
services in prlo^Srear * ,k 

Never ^^^f^ 

Seldom 

Occasionally^ or Ao^e 

Use of online service thought^ 
to improve currept^ method * 
^Yes . . 

no/don' fSknow 

Other* comments re online 

services * 

Generally positive 
Generally negative _ : 
iOther ^ K 



33 
18 



26 
1 
11 



0.0^ 
4.8 

21.0 



11:9 
■ 0.0 
0«0 

6.1 ' ' 
16.7 



15.4 
0.0 
0.0 



9.1% 
47.6 

47.4 



45.2 
50.0 
0.0 

36.4 
44 .-4 



30.8 
0.0 
45.5 



54 . 5;^ ' 
28-. 6 

26.3 



28.6 
50.0 
'50.0 



33.3 
33 . 3 



2^.9 
100.0 
36.4 



36.4% 
19.0 

5.3 



lai.3 
Q.O 



^1 



24.^2 
5.5 



'26 . 9 
0.0 
18.2 



V 




*Excludes no response 



ERIC 



TABLE IS 




1 



*iT^''^°rj^^f''^^^^"'* Service Ui?e and Evaluation as Related to Curijent 
: Use of Onlln^/Search Services, by Freguency^o^f Use: ..Industrial letting 



Total 
*NumI]He.r 
of Users 



Frecmency of Use (Percentages) 
Single Llghjt Medium Heavy 
Time ♦ . Use/ User/-^ User 

User (2-4^ 



(5-9 

times) times) 



Ever previously use online 



^ No, and not famllldr 
w/servlce ^ 

Frequency of use of online 
services In prior year * 
* Never ; • * 
Seldom 

Occasionally or moi^e -^w^' 

^ ■ . r m ^ ' ' 

Use of online service thought 
to lint>rove current Method * 
Yes 

No/don't kq^^ 

Qther comments 
services *. *'t 

Generally 'posijS^^^^V-J^^^ 

Gener^ly*iieg^ve^-V 











18 


27.8% 


■ ''27.8% 


33.3% 


33 


. 21.2 


. 51.5 


21.2 , 


57 I 


S^^:56.1 


28.1 


12.3 



(10 or 
more 
times) 



.1% 
.1 




17.7 
25.0 
25-.0 

33?3^ : r;. . ^2'.8 
35..3^V-;;],3^7 



3.5 



4.2 
12.5 
25.0 



10.5- 



20-8 66.7 



26.3 
0.0 

12.5 



10.5 
0.0 
0.0 



^Excludes np response 



^' ' ■ * • — ■ ^ ^-^^S'' ^ ■ ■ . ■■■■ * 

i settings .^ose^^'o had eVer prevloujlj^d onl,lne search^e|vlce8, 

' of^were fanrillar with su^h services, were nore/i^kely than others to be heavy ' 
users pf the^ project se-tylcea. Amonf the 10 Lers fTln the academic setting 
and 4> yie liftfs trial getting) who reported that they were at least ocdional 



users of o;illne' search servlcls in the year preceding introduction of the 
project onl^fy services all o^. the acadAnir^sers a^ half^of the industrial 

least 5 .'searched during 1^ first year of the project^ 



~7Tbr tibth the acaieinirc arid the indus trial, skmpTes who werie - 

generally positive toward thj||^1Lntroduction of online search capabilities 
and who thought that such ^rvices mignp definitely be an improvement 
over their traditional methods of literature searching were not only 
more likely to be users and to use^ the system early as reported previously, 
hut they were also more likely to be heavy \isers, conducting 10 or itore 
separate searches during the first year after introduction of the project 
services. 

Multivariate Analyses ^ • ' \ 

As a second step in the analyses, ejach predictor variable (uncd|egorized). 



which was assesseji above was regressed against a continuous variab^^: 
ref lecting the actual nomter of online ^bibliogr.aphic searches which ^i^kch' 
uaer condfucte'd during' tiffe first year aftet introdiitt^^ searcii - 

service. Each predictor vafiaih^^^hich attaine^, statistical, signl/fic^ce 
was allowed tij^freely ^tex th^^(^8iictibn equati^fein, in step|jd.Be. fashion, .-.. -i^ 
The-analysee were conduct o^^sep^K^ and the -results 



are summarized in Table 16. 



Sigi^^icaat Independ€^nt Predictors of *Numbiefi:^|jj|^^^^ Searches by 
'-•"-"^ Basi^ on Stepwise Mii^tipje Regression ^j^^ by Job Setting 



Users, 



step ■ "■' 



Job Setting/Variable 



zero- 
order 
r 



t 

try/ 



: , r • ^^;'aiii^^a se' ^. F ^ yal ue 



Industrial 



Frequency of use of 
dnline services iii. 
prior year 
' Highest degree doctorate 

Academic vo ' 

^equency of use of 
own collection of 
^inf.onnatibn 



.•28 
.26 



.28 

*.35 



-'.32 



.32 



• .08 



6.7 
4.1 



.10 



4;2# 



In neither the academic nor the the Industrial setting were there 
many variables that entered' the regression equation's significant Indep^n-^ 
dent predictors of frequency of* use of online blbllogrdpilc searching. ^ 
Moreover, different, variables entered the xegresslon/^i^Aatlon for each 



^ 1. 



of the two settings, suggesting a lack of capability to generalize the' 
. findings across the two types of work envlrono^nts. 4. • 

In the Industrial setting, the. fir^t^ significant predictor of frequency 

■^^^^ 'r^K^^^.i^ ' f ■ . . ' 

of use was the frequency of use of simfxkt capabilities in the year 

prior to introduction of the project Sexrvjces;' c^^The only other variable which 

entered the equation j/as the academic degree level of th" user, with doctorate 

■■■ -■■ . ^ \. ' ^ 

holders significantly- more likely than others to be frequent users of the 

service in the industrial setting. Thtf^ resulting multiple R with these 

. • ■■ ' ' « * • 

jtwo variables- is .35, which explalniB 12 percent of the variance in the 
frequency iWP'iise- among users who .are indusllPlal scientists and technologists* 
^ 'Fpir'the academic chemists, only one statistically slgnlflc|mt*^predfctc^ 

; variable enters the equation, explaining 10 percent of the variance/ This 

variable is a measure of the degree to which the user formerly tilled on 
>-his own cd^^^ of information for .literature seaEching. * The resulting 

i: jS^.^tls^^^^ relatlons:bUp was found to be niegjative, with n:fiose 

least likel5r,> to employ their own collection of information being most likely 
to frecjuently iise blbIlo!jj|faphlc itollne seardi services. 
Conclusion T • ■ y. - 

V .The common set of predictor variables assessing personal dnd profes- 
sional back^roun^d, Established Information styles and appralsat of adequacy 
of information resources, and measures of prior attitudes ^nd^ experience with 
online search seirvlcpiB^^^^ch were previously found to be weak predictors 
of who would USA oriiSne s^tvices and who would use them eraly. were also 
found to be relatively poor predictors of the f^Sequency With which users > 
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- ^wwld-cail-uppn-onllne"8ea^^^ 

Indeed, only one statistically significant correlate of the frequency of 
use of online services was fomd' for the- academic che'mlsts, and only 
two" significant correlates eifiler^ed for the industrial scientists and 
7 ?emnologists. 

^ Iliese resulting weak relationships^ ^based on the types of variables 

analyzed h^e, suggest that knowledge of .^uch factors cannot aid sufficiently 

in <plaiptng the likely level of demand for online search services when su^ 

capffbil:|.t^y is newly introduced intjip a work s:etting. However, the sub- 

statitial differences in rates of ^use and frequency of use between _an-^ 

f academic setting siigg^ that demand expectancies 

' .-f # ' . . W . . t . ^ ■ . , 

^^^'^^^^ generalized across settings. Th^t is, in the. industrial setting, 

" % ^ personnel— includingj scientists anii' technologists 

' . and both ^supervisory and -nonsupervisory pei:'8onnel~well under balf will 
TflS>t use the system at all during the first year; and marly who do become 
users will only do so well after-the^ service is first Introduced, and on 
r, average will use the se^ice relatively infrequently (3^2 searches per year ^ 
v / / per h^BT^i^ In comparison, #mol| academic chemists — inclusive of faculty, 
V advanced doctoral students, research aaiiai^tes and f ellov^-r-abdut; three- 

fx5iirtha-will use .the service in the^firrst year; and will tend4 use it more 
quickly and more than twice as frequently as industrial scientists and techno- 
J^ogists. : . . 
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-PHASE-I-^ANAtYStS-OF"TISE~RECORDS^ ^ 



For Phase I (free, mediated searches) the 353 uses by <^acadeinlc users .> ^ 

' ' " . j ■ •• » ■ ■ ■ ^ ' 

and'"345 uses by industrial users Were analyj^a*. For eaA use an Information 
Specialist's Record (pages 261-2) and a User Reaction Form (pag^8"263-4 )• ^ ^ 



were completed, ' 

An overview is first presented of the academic and* industrial uses, 
followed by a comparison of academic and industrial uses. Then academic 
and industrial uses are analyzed in terms of the following Use characteristics: 



^l^^^^gi^^^ ..'.Early - first 'three months 



' ' " ' Lste - subsequent 

Frequency of use ' ^^-^ 

by individual 



user: 



r 



Light* i:,^l-4 uses 
Medium - 5-9 uses 
Heavy - 10 or more uses. 



X 



' CA3:igiidar age (date 



Before 1930 





1930 


- 1939 










1940 


r 1949 




1950 


or later,,' 


of 







'1%' - • 



user (date rdpel'Ved 
ftighest degr^e) ^ j£< Before 1960 

i;il961 - 1970 



" ^ . .,■ 

#^- 71971 - 1977 



in .0& user: 



"Ml. 



For faculty .^us^rs : 

Faculii^'t^' • ' . I 

Post-doctoral fellow 6 r research 
d^sodate r.- *^ 

Graduate student 

• . ' ■ ' ' . S 




-For— Indus t rl-al— useir;- 
Supervisor 



if- 



— r; — 7 

4 ■ 



Type of appro achr i 



'Current awSren^^^^ , ; '^^^^vr- 

E3|thaustlve - o 
iiA^few references % brows Ihg jl 



^j^rr/., Facts or procedures , 



..Statistically 8 of 0.05 or higher, based on^ 

rfchi squ|re tests, are discussed when they appear to have a bearing on use 
characteristics. This is followed by a table of significant differences 
for the factors compared,. The discussion are of uses by specific groupings 
rather than of users. For example, the heavy uses category .^teiysents' 10^ 
uses by urfe^s who made 10 or more uses of the system. For ease of reading 
"fe^r or mbr^es"' defers to statistically significant higher or, lower ' 
percentage of use. 



ik ■ 

Overview of Academic Uses 



N - 353- 




■ \ ' ^ °^ sa.arch reques?H|jP|^ec^iVed in person, TwLth kbbut 

six otrC; of ten requests being rece#e^ in writing'; either instead of in 
addition to being received in person. Ni^^ Ir^^ived by phone.' ! 

About 8 percent were requests received fijpm, other than . the final us e§ About 
seven but of ten requests wejPfe for new^searches , with the remaining 'requests 
.'^PVit equally divided between c«^inuatl>n, and , modification of pre-O^ous 
j^earcheB. In a>aut; four out of ten uses, the users of the Infon^tion 
supplied -synonyms . In about two out of every' fen 'saatches the user of the 
information supplied search Iqgiq. S.ea^ c^^^ 
. English^ language publications only for ah6i^^<Sljl^^ , f or 

- authors (eitl^wl|h at vrtthout subject te'rif ^^Sl?^^^ , / 



ERIC 



■ ■ .. . 86 
— whi-le-ofrly-abotit-two-oiit-bf-^^ 

• •'•'•"rl.. . - ■; 

...tlohs wanted and about one out of ten uaes specified a date constraint. 

Fewer than five gut of ioO uses specified a journal title, the name an - 
organization, the title, of a journal article, or review article* as conr 
stralnt^/ About nine out of ten seaie'cties^ hdg as primary purp|^ ijie suppdit 
•of a research 'project. T^'^remaining searches were .pll^arlly ^ te^^ 

■ . . . . " ■ ■ • . r 

either directly or indirectly related to gspet^lfic courses; In terms of / 
types of approaches, about half of the seajdie^^ used an exhaiistlve appS^^^ * 
and abbut a fifth of the searches were for a few references on a topic. / ^ 

About one out of s.^yen was foif^current^'^areness/ and about ope out of siveri 
was for specific* facts or procedures. « ^ ' ^ • 

The purpose of the searches was to fstay current in, the user's area of ^ 
research in pver half' of the searches; to stay current in related areas in' 
about one out of six uses; for brushing up on a topic in about one out of ^ 
ten uses; for learning a new specialty in about one out five uses; and for 

|upporting on-going work witli tbeory-^ (one. out of five uses); specific facts ^' 
(one, out of three usjs^K prbcedures, and -approaches or methodology (one put 

of four uses). ♦ ^ . * 



^^^^t; , ^^her purposes mentiqii^ were ;preparatlon for an ^nterti^^^etinc . " 
(one out of twenty uses), ^^^^aratlon for an internal repo^ totttr^out of 100 



uses), preparation" for a jpaper gr publication (one put of three uses), 
preparation of ^^^^^ajtipn (one out of fS'le ' uses) , and preparation of 

of twenty n^sy. Pur^pses of use choices 
are/nat mutu^^^^^ and more than pne was checked in' a number of 

instances* ^ ' i » 

Prior t a' using the online search service about one out of four users 
SoMicted %search of printed indexes, one out of 100 ma^e use of olEne 
^^s^irch 9ldt%qch|a8Mi8ts of^^wordgf, one out of thrXa^arched hi^ p'ersonal 
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-^cument-coLl«Gfcion-and-about-oae-o 



tlon 'with colleagues. to data bases searc^l^J^;^^ 98 times 

out of 100, CHEM7071 was used one time out of four. The remalt>lpg data • 
bases t^ere used less thin one time out of ten. The totals add up to. more . 
than lOOZ because of- multiple data base; use. . * 

The number pf search statements per use feel into approxlmaS^^^ j^^?' ' . 
equal groups o^ 1-3, 4-7, 8-12, and 13 or more se^ioli sj^^^ 
The 'number of online printed citations also fell Into "four aMBH^^lT' 



J"-' 



d qnpftne 



equal groups from 0-3, 2^-10, 11-20, and 21' or more a^^^^ 

per use. Somewhat more than one out of t'hree uses h|^off^lS^S|g^|fe^^ 
tlons. Conne^ct time per search also fell Into approxlmatj^||^^^^qual- ' 
time ranges of from^one to seven minutes, 8-13 minutes, ;^^^mlnutes, and' 
o 24 or more minutes. About one out of ten uses, required n6 negotiation ' 
^^^^ out of ev^ry three uses required four or more minutes of nego- 

'tldtlon time. The remaining uses required between one and. thre0' minutes of 
^^>v^negQtlatlon; 



^^ '"^P "^^^ Was present and Interacted with [the sjrstem In seven <)ut of eve^^ 
ten searches. One out of every -three searches required post-search staff; - 

• ' " ■ ' - ■ ■ . ■ ' ■ . ■ ^ - ' 

tSlfflifv-. One out of four searcl^es had technical problems which caused delaysT 
V ^^^^^^ ^^a^ wer6^ unfamiliar with every relev^t and re^zrleve^l^afillt In about 
^ three out of ten searches but knew of relevant and npnrretrleyeS cltatloils 

In about ifour out of t^n uses. V -. i.^ , 



-In terms of users' opinions of /search, output , about two out of three • 

commente<t •tTiat' the 1^^^ about right, i>ver: eight out 

• ' , -f- ■. , • ^ ^ . . . ■ ■ ' ■ 

of ten <:ons^^^»d the currency of . the output either ^satisfactory or/.ye*^ 
■ - . ■ ' '''^ ■ ' " > ^ , ' \- 

satisfactory and over seven out of ten considered the utility of the search 
_ . • • ■ . ' . , ' ' 'v. ' ■ • ' '■ . * ■ 

Output either satisfactory or very s^atisf actory; ' v 



I 



Overview of Industrial Uses ' - * 

- ^ . 'J 

N • 345 " * - ' / 

About two out of three search requests were received In person, with 
about one out of four being received In writing or In writing as well as 
In perspn. About on|B out of six requests were received by phone. Only about 
two out of 100 uses were received by other than the final user of the search 
results. About two out of 6very three searches were new searches, with the 
remainder being continuations or modlflckjtlons of pre)^ous searches. Synonyms 
were supplied by the. user In over half of the search^^ and search logic In 
about one out of six searches. 

As to search constraints, about two out of 100 search constraints 
had. an English only constraint, about seven out of 100 searches had an author 
constraint (either an author search or a subject s'^ealrch with auth9r(s) specified), 
About six out of 100 searches had a type of publication co^tralnt. About 
three out of 100 searches specified a maximum number of citations wanted. 
Only one out of 100 searches had a date of publication constraints 

For types of searches, one out of three was exhaustive, one out of six 
was for a few references on a subject, one out of three was for specific facts 
and procedures, and. about one out of ten was for current awareness. 

The purpose of the search, a hon-mutually exclusive choice as was already 
Indicated, was to stay current In the user's area of Interest (about four 
out of ten uses, as has already been Indicated In the discussion of academic 
uses), ^stay current' In a re it<^ area (about one , out of ten uses), brush- 
ing up (about one out of eleven iises) , learning a new specialty (one out of 
five uses), support of ongoing project with theory (one out of eight uses), 
^ith facts (one out of five uses), support of ongoing project with theory 
^one out of eight uses), with facts (one out of four uses) , with procedures, 
apparatus or methodology (one out. of two uses), the preparation for Internal 
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:©e^t-lng8-(three-oatr-x>f-l(K>h-then^^ 



out of 100), the preparation of . patent alppllcatlons (one out of 100), the 

/ 

preparation of publications or papers (five out of 100). 

it. 

About one out of four online search requests was preceded by searches 
. / ^ 

of printed indexes. About four out of 100 searches were preceded by use of 

'* , * • . 

online system search aids, about four out^of ten by users searching their 

own collection of documents, and in about four out of ten uses by dis- 

'' ' * ' . 

cussions with colleagues. Data ^ases searched were CHEMCON (over eight out 

of ten uses), CHEM707^ (abo|nt three out of ten uses), COMPENDEX (one out 



of ten uses), NTIS (four out of 100) with all others being used five ti^s 



out of 100. • ^ 



About one out of tl\ree uses required 13 or more search statements, one 
out of eig^t 'required one to three search statements with the remaining 
searches requiring fojir to twelve search statements. Only six out of^^jML^ 
searches hac^mbre than 20 online printed citations, and about a third of the 
searches ha/ zero to three online printed citations with the remaining 

searches having four to twenty online printed citations. About two out of 

* . ■ .* 

.three searches had offline printed citations. 

About. orie out of five searSh^s required more than 23 minutes of computer 
connect time and one out of five searches required one' to seven minutes of 
connect t^me with the remaining searches requiring eight to t<?enty-three 
minutes; of connect time. 

The user was, present and interacted in Amewhat less than half of the 

time. Technicafl difficulties delaying searches occurred about one time out 

of. six. As to user^' reactions, about four. out of ten were unfamiliar id.th 

any of the relevant and retrieved citations but over half noticed the absence 
/' ■ 
y of relevant documents In the output. About two out of three considered the 

' search output of just about the right size. About eight out of ten cqnsld^ed 
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he-curt|ency^-of--rite-outpo 

three out of four considered "the utility of the search output satlsfactoiry 

or very satisfactory. ■ . 

Comparison , of Academf^sgn^ Industrial Uses 
Academic uses ^ N. » 353 

Industrial uses \ N " 345 ^. ^ ' 

More academic searches were received In person and more academic users 

Interacted with the system during : the search than was true for Industrial 

searches. This may have been due. In part, to the more convenient location 

of the academic search office (located centrally In the one building where 

• - * 
most of the^ users have their offices and laboratories) and. In part, to the 

academic users' grt^ter need to interact?- with the literature during the 

search. This probably explains why no -academic search requests were received 

• ■ \!;' ' 

by phone. However, more academlc^searches were requested by someone other 

./■'■** ' 

than the flnal^ user of the search reisults. ' This may have been so because 
of graduate' students requesting searches for their professors and for o^:her 
students not in the sample. 

Industrial users ^ supplied synonyms more of the time. This cannot be 

•>» ■ * 

explained on the basis qf da^ base, searched since both groups made greatesit 
use o**' CHEMCON and CHEM7071, a data base without vo^lbulary contrbl. Academic 
users had more author and time constraints, but fewer constraints by type of 
publication. The greater use of search ^onstraints may be an^dicatlon of 
either greater need for more specific searches and/or greater skill in the 



uaj of the system. Since data 911 thl's'^polnt are not consistent, no conclusion 
may . be drawn. . ^ ^ 1 * 

In terms of types of approaches, more academic uses were for exhaustive 
searches, explainable in part by the greater number of searches for disserta- 
tions and grant, proposals. There were also more academic uses for a few 
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of the search office but there ^ere fewer academic uses for specific facts 
or procedures. This may ie explained by the availability of other^ Informa- • 
tion koiirces In an academic envlrdhment~the colleagues or the professors 
who iiave the Information. More academic users had as their purpose staying 
current in either, the user's area of Interest or in' related ^reas, to prepare 
publications or papers, and to support worTc on a project with facts or 
theory. . Fewer academic uses were for procedures, apparatus, or methodology, 
for. Internal reports, and for patent applications. The latter two c^n be 
explained by a lesser need for internal repotting and patent applications in 
an academic environment*- 

Fewer academic users used search aids such as lists of terms prior to 
'requesting a search. This may either be explained by their greater familiarity 
- with the vocabulary for their search or on greater reliance on the Information 
specialist to do this task. The fact that fewer academic users discussed 
their search with ci^leagueg prior to requesting an online search may be due 
to, the graduate t^tudent users who have not had a chance to establish col- 
'leagues. Academic users made greater use of CHEMCON either singly or in - 
combination with other databases and made lesser'^use of COftPENDEX and NTIS. 
This Is not suprlalng since all academic users were chemists while Industrial 
users lnoludd^',8)eientlsts , In -other 'dlsclpir: ^e- and engineers..- Academic users 
used fewer search statements on the .average, retrieved more citations online 
and hid more searches without "offline citations. These search characteristics 
may be iattrlbuted to the more frequent presence of the final user during the 
search l^nd his Interaction during the search.' Academic users had more tech- 
nical problems In terms of log on and delay during the search, explained In part ^ 
to the use of a T33 teletypewriter term^l during -tha. early months of tjie 
search. •' ■ .fT^ °- . - ^ 

Academic users retrieved mope .^^ocuments with which they were^t!famlliar. 



erIc;. *' • . ^ : ico 



Slnce-therc-was- no-difference -±n"^req^ency~pf-use-o€rprln 

to the search, this difference may be attributed tb the Academic users' 
greater familiaricy with the llte^ture. , This conclusion is strengthened 
by the fact that more searches for academic ushers did not retrieve -documents , 
with which the users were familiar and that should have been retrived. 
, Academic users were more satisfied with the currency of the search outpnt but 
equally satisfied with its size ^nd utility. " m ' 



TABLE 17 



yAcademlc^ versus Industrial Uses 
— _ \ ^ 



Item 



Academic 



Industrial Slgfnlfic^nce 



Search requies^ received 
In writing 

In person > * 
By plibne 

- By otHter than final user 

. ■ . - 

User assistance 

Synonyms supplied 

Search constraints 
Author 

Publications , . 

Time period 

Other ^ ' 

Other, patents 

Other, excluding patents 

Primary appll cat Ion 
Dissertation 
Grant {proposal 
System test - ' 
Technical repqrt \ 
/ Other ^ ' \ 

0 

Type of approach 
Exhaustive 
A few references, 

browsing 
Specific facts, 
^ procedu2?)es'' 
* 

Purpose of use % 

Stay current, own area ^ 
Stay current, related 
area 

Supporting project — theory 
Supporting project — facts^' 
Supporting proje<^t-— ^ , - 
pirocedures - a; 



Preparation for 
Internal report 
Patent application 
Publication 



Sources used prior to Search 
Online system aids 
Discuss with collea|gues 



60.6 






• UUl 


91.2 


67.8 




.001 




15,9 




.001 


7.9 


2.3 




.002 










"43.5. 


56.8 




-.003 


19.9 


■ 

6.7 




' .001 


0.0 * 


5.8 




.001 


11.3 


1.2 




-.001 


5.7 


/ • 1-2 




.003 


0.0 


3.5 




.001 


.0.0 


. ' 1.4 




.003^ 


2o:i 


0.6 , 




.001 


5.7 






.001 


0.3 


0.9 




' .001 


0.0 


• ^0:3 




.001 


12.7 


8.1 * 




' .001 


49.6 " 


"33.3^^ 




.Ool 



■22.1 
13. S 

52.7 

16.8 
18. .7 
36 . 3 

24.6 



• 0.8 
0.0 
32.6 



0.8 
22.7 



13.6 
39.1 

40.6 

10.4' 

12.5 

25.1. 

53,0' 



4.6 
1.7 

-f^.2 



3.5 
38.3 



.001 

' .001' 

.002 

.03 
.04 
.002 

. .091 



.005 

.04 

.601 



.04 
.001 



Item 



Academic 



Industrial Significance 



Number of search statements 
"^"^ ^ 

4-7 . 
. 8-12 

Files Searched 
CHEMCCW _> 
COMPENDEX ' 
NTIS 

Citations printed 
Online 

. 0-3 • 

4-10 

11-20 

21+ 
Offline 
. 0 

l-h 

User present for search ' 
In person 
• By phone 



User interaction vtth search 

' Technical problems — delay 

' VechnlcAl problems — log-on 

Citations 

Number already familiar 
1-2 ^ 

s: 7+ 

Number not retrieved' 
0 

1+ 

Opinion on citation currency 
Very satisfactory 
Satisfactory 
Unsatlsfaptory 
Highly unsatlsfaptory 



28.0 
26.6 
24.4 
.21,0 



94.6- / 
0.3 
0.3 



26.1 
23.8 
24.9 



63.7 
36.3 



70.0 
0.0 

71.1' 

23.8 

10.8 



19.5 
19. '5 
30.3 

58.1 
41.-9 



43.9 
43.1 
1.1 
0.3 



12.5 
29.0 
s. 24.6 
31.6 



83.5 
10.1 
4.3 



36.8 
37.1 
20.0 



36.8 
63.2 



44.6 
1.7 

43.2 

17.4 



12.2 
14.8 
31.^ 

43.5 
56.5 



34.8 
49.3 
3.2 
1.7 



.001 
.001 
.001 
.001 



.001 
.001 
.001 



.001 
.001 
.001 



.001 
.001 



.001 
.001 

.001 

.0t)3 

.001 



.003 
.003 
.003 

.001 
.001 



.02 
• Oi* 
.02 
.02 



Early Use r First three months of 'use; N-101 

Late Use - Subsequent months of use; 4-11 months of use; 

N-252 - V • 

- The later uses tend to be repeat uses^ wlth'^only 14' out of 51 later 

uses being requested by initial users of the system. Most search requests 

ifere received ii^ person^^ut there were fewer search requests received In 

person for later;, uses. Few searches were received by other than the final 

user of the information but the number of such requests by other than the 

final usWswas higher for the later uses. Both of these differences in 

later uses may be due to one or a combination of the following factors. ^ 

^^^^e noyelty effect of watching a search being performed might have 

worn off. Also, the later user might consider himself sufficiently familiar 

with the system to use it without being present. This, hoji/ever, may not 

be a permanent attitude since some^riiat more knowledge of the system might 

persuade the user that interaction with the system is highly desirable. 

The later .user who did not come to the system in person may be a user 

who has graduate assistants to delegate searches to. For the analysis of 

uses by position, it was found that fewer faculty were present and interacting 

during the search. . - 

Later searches showed greater use of search constraints, such as author 

or time period constraints, and this may have beep due to increased familiarity 

with the system's optlohs. Most searches- listed research as the primary 

application of search results but later uses listed more searches for* other 

than research applications. This may also be an indication that when users 

become familiar with what the system can do, they use it for a greater variety 

of tasks. The wider application of search results is also reflected by an 

increased number of later uses for different purposes related to research 

projects «u.eh as keeping current in related areas, learning a new specialty, 



ioofcins for refere nces on theoretical aspects of a project." ^n^^i.^nfng Informa- 

* tiqn procedures, apparatus or methodology, and assistance In preparing f or . ' 
internal meetings and , In writing grant proposals. . % ' 

A higher number of later users used CHEMCON either In addition to or 
ins'tead 9f other -bibliographic data bases. The amount of ^e spent on- ' ' 
search negotiation went down for later uses, probably an indication of more 
efficient negotiation (less time spent on explal«^g the system) with experi- ' 
ence. . 

The amount of computer connect time an.d post-?earch staff time per 
search also went down for later uses, again a probably indication of more 
efficient searching with experience on the part of both the user and the 
Information specialist. There was no significant difference between early ' 
and late uq*s' user feedback on output size, currency, or utility. 

Conclusions that may be drawn for a comparison of early and late uses ' 
are that with experience more efficient use is made of the system, that the 
system is used more extensively for different^ types of purposes, and that 
more of the system options are used. 

TABLE 18 ' • 

) . 

Time of Use by Academic Users 



Item 



Early 
N-101 



Late Significance 
N"25'2 (less than or 

- to .05) 



Search request received 
In person 

By other than final user 

Search constraints- ' 
Author 
Time period 



. 97. OZ 
3.0 



11. 0 
3.0 



88.9% 
9.9 



.23. S-* 
14.7 



.03 
.05 



.02 
.004 
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TABLE 18 (continued) 



Item • ( 



Early 
N-101 



Primary applications 
Research 

Other— Qourse related 
' Other-- not course related 

Purpose ,of- use 

Keep current, related areas 
Learn new specialty 
Supporting project work— , 
theory 

Supporting project work — 

procedures 
Preparlilg for Internal 

meetings - ^ 
.Dissertation . 
Grant proposal 
Testing system 
Other 

" "File searched . * 

* CBEMCON 

glefcotlatlon time (min utes) 

/ 0-1 « — 

i 2-3 • 

Terminal connect time (milnutes) 
; 1-7 : ^ 

8-13 
14-23 
24+ 



Post-search staff time with u ster 

(minutes) 

0-l5 
.2+ 




95.0 
10.0 
13.3 



6.0 
5.9 

8.9 

10.9 

0.0 
19.8 
2.0 
1.0 

:i.o 



87. J. 



18.8 
24.8 
42.6 



M5.8 
20.8 
22.8 
40.6 



31.7 
22.8 



•Late 
N=252 



81.0 
90.0 
86.7 



21.0 
25.4 

22.6 

30.2 

6.7- 
20.2 
7.1 
0.0 
17.5 



97.6 



32.9 
25.8 
30.2 



24.6 
31. 1 
25.4 
18.7 



23.0 
9.1 



Significance 
(less than or 
= to .05) 



.'002 



.001, 

/.005 

.001 

.02 
.001 

.o'ol 

.001> 
..001 

.001 

.04 . 
. 04 
.04 



.001 
.001 
.001 
.001 



.001 
,001 
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Time of use ^^t>y Indus trial _u8er8 ^ 1 - , 

Early use (first three months; N«52. uses) 

Late use (subsequent use; N-293 usesX ' 
• Ljater searches included fewer search modifications but more new searches 
' and more contlnuatlons^^of prior searches. ^Th6 smgller number of" search modlf 1- . 
cations may be attributable to greater skill on the part of the Information 
specUllst in conducting the search as" well as gujeatkr ak-11 on the part of^ 
the user in r«.questlng the needed searches . Fewer of the later searches werV 
eixhaustlve searches, perhaps because of the user's realization of the utility 
the online system for pther types of approaches. More of the later searches ^■ 
■ were done for staying current In the user's area of speclallzaglon and for / 
supporting dngolng projects with theoretical findings. Fewer manual searches 
of printed lnde:<e§ were made prior to requesting later searches, an Indication 
of greater confidence In the online system. More later searches made use of 
CHEM7071, an Indication that over a third of these later searches went farther 
back In time. Fewer later searches had' of f line citations printed. This, 
however, was a result of changes In procedure on the part of the Information 
specialists rather than a change In user demands. 



TABLE 19 
Time of Use by Industrial Users 



Item . • * / 


% — 

Early 


Late 
N«293 
» 


Significance 
(less "than or - 
- to .05) ' 


Relation to previous searches 
New search 
Continuation 
Modification 


63.8% 

13.3 

22/9 


67.5% 
17.6 
5.9 


.000-. 
.000 ' 
..000 


Type of approach 
Exhaustive 


*51.3 


24.3 


■ .000 



TiUtOf 19 Ccontlnued) 



4 



1% 



Purpose of nae 

Keefi carrent, om area ■ 
Supporting project — t^^eory 

Sbnrces used prior to sear A 
Ifaimal searched Indcses . 

Files searched] 

CHBIf7071 o ' 



Early 
R«52 



65.2 
19.1 



37.4 



7.0 



Late Sif^'flcanbe ^ 

ll«293 ''^ (less than or 
- to .05) 



28.3 
9.1 



15.2 



39.6 



.000 
.01. 



.000 



.000 




Frequency of Otfe by Academic Psers 
Li^t - 1-A uses" per 



tic Osers t 



ERIC 



V Mediaip - 5-9 oies per user (R - 113) 

- jip or aore uses per user (R = 169) 



This analysis of the data is in soae respects sii^ar to the ti»e-\of 



use 



analysis in that it coiq>ares users with different aaoonts of systea experience 



^Ihe frequency of use ccaq>arison groups users into three categories by nn^>er of 
iifuuxhes requested. This again is not a cbaparison Without flaws since tii^ heavy 
uses .include records of such userTvhen they were early (inexperi^ced) usees 
and since sok of the li^t users -aight have had experience with another online- 
searched index. Despite these contaijlnating factions both later uses 'and hea^ 
ose^ eadiibited changes that are probabl^due to the^]^^ of experience on the ' 
part^ ofShe heavy and/or late usexs^ 

Fewer of the searches Ij heavy users were received in person and aore of 
thess search re<inest8 were received by other than the final user of the s|arch 
results. This parallels the findings for the late uses and can prob^ly be * 
e^lfined in the saK way. There is one additional point that should be 



1 



■ ■ ■ ■ \ -■■[ - ■ ■ . ■ - -.^^ ^ 

• . 100 ' .t. 

.mentioned. Heavy users have ; more current awareness searches. In fact, such 
' searches , -Sifhen updated periodically, account to some extent for the category 
of heavy user. When current awareness searches are not modified, ttiere is no 

. . [ - • ^ ■ .. ^ ♦ 

nctd for the user pelQg present. As . wlth^ late , uses , heavy uses included 

' «• ' ' - - ■ ' ■ * 

mor6 time period constraints. Unlike the later uses, heavy uses had more 
searches wlth^ search logic supplied than did the light arid medium uses. The 
3 increased use of Search logic may be explained by greater familiarity with the 
sys|Pkr on the part of the heavy user. 

Both later and heavy users had fewer searches marked as being primarily 
for rrtearch, an indication of \Hder tiise jDf'the system for other than supporting 
work on research projects.. As with later ^ers, uses* by heavy users had more 
searches for sOpying current in related areas, for procedures, apparatus and 
methodology, and for writing grant proposals. Fewer searches by heavy us^s 
were preceded by manual searches of indexes, partly an Indication of greater 
confid^nc^^n the online searched index, and partly the influence of the 
-current awareness seiches which cannot be searched in the printed indexes. 
The fewer searches by heavy users being preceded with searches of the' user's \ 

* r ' 

personal collection can be explained in the same way. However, fewer discussions 
with colleagues prior to online searches fdr searches^ by heavy users can be 
explained by either increased conf id^fnce^W the system pr fewer' knowledgeable 
colleagues to talk things oyer with, the latter most likely in tl?e case of 
graduate students. There was less negotiation time and post-search staff time 
for searches by heavy users just as was the case for ^ate users and probably 
' for the same reasons as given above. 

Searches by heavy users included a larger number of new (to the user) 
references in more of the seariheJ^. The use records of heavy users indicated 
that more of the retrieved references were to 6e investigated than references 
retrieved in searches by other than' heavy users^. 

There was no significant difference in user feedback on currency, size, 



ERIC 
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or utility of search output on the part of light, medium -and heavy users. As 

..^•v • . ' ' * s X — 

with the deita for early versus late use, data for frequency of use suggests 
that, Vlth ejcperlende, u^ers^'wlll use. the system ^for ^^reater variety of ' 
Information. needs, make greater use of the system's options but will change 
their opinion of >|:he 'output of the system. 



TABLE 20 

Frequency of Use by Academic Users 



r 



Item 



Llgh 
(1-4) 



* Medium 
(5-9) 



Heavy 
(10+) 



Significance 



Search requeat received 
In person 

Other than final user 

Relation- to previous searches 
New siearch 
Continuation 
Modification 

> User assistance 
Logic .supplied 

Search contraints 
Time period 

Primary applications 
Research 



Type of 



\ 



a pproach 
Current awareness 
Browsing 



Purpose of use 

Stay current , related &reas 
Supporting project — 

procedures 
Preparing internal report 
Preparing publication 
Dissertation 
Grant 



88. 7Z 
8.5 



84.5 
7.0 
5.6 



9.9 



0,0 



lOJO.OZ 
0.0 



77.9 
6.2 
14.2 



22.1 



8.0 



86. 4Z 
13.0 



V 58.0 
\ 17.2 



20.1 



27.8 



18.3 



.001 
.001 



.001 • 

.001 

.001 



.01 



.001 



95.8 


• 84.1 


81.1 


.02 


4.2 


10.6 


17.8 


" .02 


7.0 


7.1 


1.2 


.03 


8.6 


14.2 


21.9 


.03 


31.0 


15.0 


?8.4 


*.02 


0.0 


2.7 


0.0 


.05 


45. i 


32.7 


27.2 


.03 


22.5 


23.9 ' 


16.6 




2.8 


3.5 


8.3 





n 
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\ TABLE 20 (continued) '"^^ 



Item 



Light Medium Heavy Significance 

(1*4) (5-9) (10^ 



.Sourdes used prior to search 
Manual search of indexes 
Online system aids 
Personal collection 
Discuss with colleague 

Negotiation time 
0-1 

2-3 " . 

it+ ' . 

Citations printed online 
0^3 

4-10 ' ■ V 

L-20 . 
11+ 



\ 



Post-search staff time with 
(minutes) ^ 
1 

2+ 

Citations— new references 
0-2 
3-8 
9-18 
19+ 

Citations to investigate 
0-2 

3-5 ^ 

6-12 

13+ 



user 



A5.1 
0.0 
A6.5 
38.0 



22.5 
16.9 
50.7 



18.3 
31.0 
31:0 
19.7 



a4.8 
2.7 
37.2 
21. A 



2A.8 
32.7 
33.6 



20. A 
21.2 
31.0 
27. A 



22.5 
0.0 
28.4 
17.2 



3A.3 
4 2A.3 
26.6 



33.1 
22.5 
18.3 
26.0 



.002 
.05 
.03 
.002 



.005 
.005 
.005/ 



^02- 

;o2 

.02 
.02 





31.0 


33.6 


17.8 ' 


.001 




, 19.7 


14.2 


9.5 


.001 












35-. 2 


30.1 


21.3 


.03 




26.8 


22.1 


24.9 


- .03 




18.3 


12;4 


25.4 


.03 


, V 


19.7 


35.4 


28.4 


.03 




/■ 










38.0 


32.7 


21.9 


.008 




21.1 


20.4 ■ 


. 23.1 


' .008 




21.1 


11.5 


27.2 


.008 




19.7 


35.4 


27.8 


, ..008 



Frequency of Use by Industrial Users 

Light use - 1-A times per user (N » 1A3) 
Medium use - 5-9 times per u^er (N - 101) ^ 
Heavy use - 10 or more times per user (N - 101) 

Somewhat more searches by heavy users were receive^* In wrlplng and/or In 
person f an Indication that the experlen'ced (heavy) user has a preference for 
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these approaches, A smaller number of searches by heavy users are received 
by phoner that Is the other side of the coin. No consistent patVern exists 
In supplying search lo^^i^, — Ifeers In the medium groups s^ilpptted search iogl 
more ^Ifequently than us^rs In the other two. groups. Heavier users have 
more' continuing searches and modified searches b€rt fewer new searches than 



xn 
I mo 

^mo' 



c 



do other users. Heavy users did not specify a maximum number of citations 
\ "trl^ved. This was only done in a small number of uses for the other 

\users ^d may be a reflection of the absence of a charge for the searches. 
In pu3;^o||^e of use, mote of the heavy uses were for current awareness 
which, as tfes pointed out in the academic usage discussion, is in part what 
makes a user a heavy ^ser. Heavy users also made the largest number;;, of uses 



of the system for searches on theoretical woA and preparation of internal 
meetlngi 



Heavy users were nelthetv*lgh nor low in terms of using the system 
for exhi ustlve searches, for staying >ur rent in related areas, or for developing 
new specialties. Fewer heavy users searched internal company reports prior 
to online search requests. Heavier users made more searches of CHEMCON but 
fewer searches of COMPENDEX, perhaps an indication that the scientists made 
grater use of the system than engineers. The heavy user was likely to mak^ 
more ofEline pxinting requests. Heavy users were more satisfied with the 
Utility of search output than users in the o^her two groups. 



J 



TABLE 21 

f 

Frequency of Use by IndyaXrlal Users 



Item 



Light 
(1-4) 
N"j.43 



Medium 
(5-9) 
N-101 



Heatry 
(10+) 
N-101 



Significance 



Search request received 
In writing 
In person 
By "phone 

User assistance 
Logic supplied 

Relation to previous searches 
New search 
^ Continuation 
Modification 

c 

Search constraifats 

Maxlmuji nuniber of citations 

Type of approach 

Current awareness 

Exhaustive 
^ Stay current, related areas 

Purpose of use 

Learn new specialty 
Support project theory 
Support project facts 
Prepare for internal meeting' 

Sources ttt^ed prior to searc^i^ 
Internal company repc^*^ 

Files searched 
CHEMCON 
COMPENDEX 

Citations printed off-line 
1+ 

User opinion of utility of results 
Very satisfactory 
Satisfactory 
Unsatisfactory 
Highly unsatisfactory 




26.6% 

58.0 

20.3 



13.3 



81.8 
7.7 
4.9 



5.6 



5.6 
25.9 
15.4 



26.6 
12.6 
26.2 
2.1 



14.7 



83.2 
12.6 



62.9 



41.3 
28.0 
14.0 
5.6 



13. 9Z 

73.3 

18.8 



26.7 



62.4 
19.8 
12.9 



1.0 



5.9- 
40.6 

5 



11.9 
4.0 

16.0 
0.0 



10.9 



77.2 
13.9 



54.5 



60.4 
14.9 
5.9 
7.9 



27. 72 
76.2 
619 



11.9 



55.4 
21.8 
16.8 



0.0 



16.8 
36.6, 
7.9 



13.9 
20.8 
32.7 
5.^ 



1.0 



90.1 
3.0. 



72.3 



53.5 
30.7 
6.9 
3.0 



.03 

:005 
.02 



.007^ 



.001 



.02 

.005' 

.04. 
.04 



.006 
.002 
.03 
.03 



.002 



.05 
.02 



.04 



.02 



Calendar Age ixf Academic Users^, c 

Born before X930 \ N » 39 (uses) 
1930.- 1939 ; N » 4 4 



0 



1940 - 1949 . " ■ N - 155 ^.K^^ 



or later. J^^. N - 115 

•Mi"*' • • • 



' The 3^ uses were analyzed to determine yhether youngei: rfsers, thos 
27 yearar or younger, used the system differently than other users. User 
studies suggest th^t younger users are less set In their Infotmatlon hab 
.Its since they^have had less time to develop and live with them. Fewer 
search requests by younger users were presented In writing; perhaps be- 
cause more younger users brought In their requests not fully thought out 
and ready to put In writing. Fewer younger user requests had author con- 
straints (except for requests by users 47 years or older). ^^Is may be 
explained by lesser use of the system for author searches or lack of fa- 
mlllarlty with authors In a given subjecfr and thus lesser use of authors 
as a me^ns for, reducing search output^ Fewer requests by younger users 
were directly related to research ;proJects with a larger number related 
to teaching. This may be explained by the younger^, users' greater need 
for Initial coUrse material preparation. Fewer a^arches by younger users 
were exhaustive searches and searches for staying current In one's area 
of Interest. The latter might be due to yourt^er users ' narrower subject 
Interests and, perhaps, ability to ke^jpi:^^ reading a relatively small 
number of primary journals. Younger users may also be doctoral students* 
who may be helped In their current awareness efforts by their faculty 
advisor. There appears to be no special pattern for younger users In 
terms of purpose of use. I.e., for specific facts of procedures, and/or 
theory. In view of the number of doctoral students Included In the young- 
er users group, it Is not surprising that more of their uses were for 

il4 ^ 
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..^.^^Issertatlons and that fewer uses were for publications and grant pro- 
posals. Fewer requests by younger users were preceded by a search of 
. a personal 'document collection (fewer younger users probably have such 
a col|ei5tlon) oi^ discussion with colleagues (those also take time to ac-r 
quire) . Fewer uaes by younger users were In the Smithsonian Science In- 
formation (SeiE) data base and In other than the Chemical Abstracts and 
Englneerlitg Index .data bases . More of the 27.-37 age group =users were 
present and Interacted during the search, ano|her Indication that searches 
requested by these ag^ groups are brought In a mote negotiable form than, 
searches brought In by older users. \' 

Uses by older useirs (47 years or older), were ranked lower In utility 
by the Users than searches for younger users , perhaps an- ^dl cat Ion of 
a more critical attitude and/or familiarity with the literature. 




TABLE 22 



Cadendar Age of Academic Users 



Icem 



Search request received' 
. Irf writing 

, , ■ 1*: ■ '■ 

Search coiis tralnts 
3 



1 

Birth Date 



Before 1930- 
1930 1939 



1940- 
1949 



1950+- 




Research 
Other, courage related 
Other, not course related 

Type of approach 
Exhaustive 

Specific facts , procedures 

Purpose of use 

Stay current, own sreas 



76.9% 
7:7 



94.9 
2.6 
0.0 



48.7 
12.8 



68.2% 60.6% 52.2% 
34.1 ' 21:3 



81.8 
, 2^3 
li.4 



own axi 

:t - a,€ 



51.3 
30.8 
28.2 



Support project - theory 
Support project - facts 
Support project - procedures 15.4 
Prepare publication 53.8 
Dlsi?ertatlon . 50. 0 

Grant 1 IB t 33.3 



91.0 
1.3 
3.2 



16.5 



74.8 
5.2 
17.4 



Slgnlfl- 
cance 

.04 



.04 



.001 



;ooi 



68.2 


52.3 


39.1 


.009 


0.0 


'. 18.1 


13.9 




» 








59.1 


60.0 


40.9 


' .02 


-9.1 


22.6 


13.0 


.02 


<!'38.6 


44.5 


27.0 , 


.02 - 


4.5 


29.0 


29.6 


^ .003 


38.6 


45.8 


5.2 


.001 


0.0 


68.3 


54.8"^ 




94.1 


2.4 


I'M 


.001 
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TABLE 22 - continued 



Item 



/ 

Birth 'Date 



Sources used prior to search 
• ^Personal collection 
Discuss with, colleague 

Piles gearched 

Other than CA and 
' ^ Engineering 

SSIE 

User present during search 
• In person 



User Interaction 

Utility of results 
Very satisfactory 
Satisfactory . 
Unsatisfactory 
Hl^xSy unsatisfactory 



Before 
1930 



35.9 
30.8 



12.8 
7.7 



46.2 
50.0 

56.3 
21.9 
12.5' 
; 9. 4 



J.930- 
1939 



45.5 
27.3 



18.2 
9.1 



1940- 
1949 



41.3 
27.1 



Calendar Age of Indtistria l Users 

\ ^ -r—. — J — '■ 

Bom before 1930 
; 1930 - 1939 
, 194Q - 1949 
195Q or later. 



65.9 



.68.2 



72.7 
18.2 
4.5 
4.5 



3.9 
1'.9 



77.;1 

76.6 



66.2 
20.6. 

7.4 
' 5.9 



1950+ 



21i7 
12.2 



2.6 
1.7 



^,6 
73.7 



46 . 7. 
39.3 
10.3 
3.7 



/N'= 71 
N - 176 

N - lb 



Signifi- 
cance . 



.004 
.004 



.001 
.04 



.002 
.02 



.03 



The number qf usea^by users 27 years or young% was too Idw (10 us^) 
to be able to say much. If anything, about this group of users. Looking 
at the uses by^the oldest group of users (47 years old or older), one. 
might suggest the following. Olderusers who are likely to have more job 



responsibility that keeps them 6t their desks ^^e more uses via the tele- 
phone and were present during fewer searches and interacted in fewer search 
es. Older users made no current awareness searches (either* because they 
might have assistants to help with this work or because their job might 
not require keeping up with the published literature) . Older users made . 
leas use of the system for learning a new specialty and this might be 



explained by a lesser need for such a^'task by the more established em- 
ployee. Searches by older users went farther back In -time than that of 
other users as suggested by the heavier use of CHEM7071. Older users 
made less use of COMPENDEX and PPLLUTION. 



. TABLE 23 
Calendar Age of Industrial Users ^ 



- \ " \ \ . , Birth Date 



,.„i 



Before 1930- 1940- • Slgnlfl- 
1930 1939 1949 1950+ cance 



Search request received " - 

By phone 26.8% ' 12.8% 13.2% 10.0% .05 

Type* of search , 

. Current awareness 0.0 9.6 13.2 10.0 .02* 



Inteft of use f 



L'eam new specialty 8.5 16.8 23.5 50.0' .004 
File used 

CHEM7071 46.5 28. o\ 20.6 0.0 .001^ 

COMPENDEX 7.0 8.8 ) 11.0 40.0 .02 

POLLUTION . 0.0 , 2.4 0.0 ' 20.0 .OQl 

^ User present foir search 

In person 31.9^ 42.7 55.8 50.0 

By phone * 4.3. 0.8 1.6" 0.0 

- t ■ ■/■■., ' - - ■ 

User Interaction with search 30.9 • 38.7 58.1 40.0, .001 

Professional Age of Academic Users j 
Highest degree received: 



Before 1960 N = 



■45 



1961 - l«p » N 
1971 - 1977 N 



The 353 uses were divided by professional age of the user, the num- 
ber of years since the user obtained his highest degree. This was done 
In part to determine whether users with relatively few years of profes- 
sional experience (younger users) made different use of the system than 
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*;the other, .older users. The other reason ifor this analysis was to coo- 
pare young, users in terms of calendar years with young users fn""t-enns of 
yeats of professional experience. ' 

Fewer of the searches by younger professional age were submitted in 
writing. This parallels the finding for the younger (calendar age) usJrs 
' "probably for the reasons already given. For ^requests received by 

other than the final user of search results and search constraints by 
time period, u&es by the younger users were between those of the other 
two groups of older users. Only the older users requested English-only 
search constraints and that only in a small number of cases, k The fewest 
_ requests for current awareness searches were madl by the younger users, •** 
■ ■ again probably for the reasons , given under calendar age. As with the 
younger calendar age group,- the professionally younger-aged made .more 
use of the system for dissertations and for feVer publications of papers 
and grant proposals;- Younger scientists made lit tie, use of the system 
for internal meetings and no use for internal reports. This may be attri- 
butive to t^le younger users' lack of involvement in such activities. 
Younger users made highest use of the system fbr a few references on a 
topic and procedures, methodology and apparatu^^d the lowest use for 
facts. Younger users used manual searches of indexes more times than 
other groups, either because of leiii^er confidence in online searched in- 
dexes, and/or because of lesser availability of personal document collec- 
tlons and discussion with colleagues. Uses by younger users required 
more negotiation time, another indication that the searches by younger 
users were less ready to be run.. Search connect time ^or younger users 
falls between the other two groups. Younger calendar and professional- 
aged users were both present and interacted more frequently than the 
Other groups during the search. More Of the searches for younger users 
were considered satisfactory or very satisfactory in terms of currency 
ERJC and utility of output. i^g 



uo 

TABLE 24 



V 



Professional Age of Academic Users 



Item 



Search request received 
In writing 
In person 

By other? than final user 

Search constraints 
English only 
Time period 

Type of approach 
Current awareness 
A few references 

Purpose of use 

Supporting project - facts 
^Supporting project - 
procedures 

Preparation for : 
Internal meeting 
Internal report 
Publication 
Dissertation 
Grant proposal 

Source used prior to search 
Manual search of Indexes 



Highest Degree Received 



(mln.) 



Negotiation time 
1 

2-3 
4+ 



Terminal connect time (mln.) 
1-7 

8-13 ( 

14-23 

24+ 



User present for search 

1 

User Interaction with search 

User opinion of results 
Currency : 

Very satisfactory 
Satisfactory 
Unsatisfactory 
Highly unsatisfactory 



Before 
1960 



77.6% 
98.0 
2.0 ■ 



4.1 
4.1 



18.4 
12.2 



36.7 



1961- 
1970 



49.3% 

50.8 

19.2 



0.0 
23.3 



23.3 
9.6 



47.9 



1971- 
1977 



60.8% 
93.1 
6.0. 



0.0 
9.2 



8.8 
23.0 



31.3 



6.1 


26.0 


28.6 


0.0 


17.8 ^ 


1.8. 


0.0 


4.lii 


0.6 


38.8 


46.6 


26.3 


6.1 • 


6.8 


25.8 


22.4 


9.6 


0.9 


14.3 


26.0 


32.3 


34.7 ' 


24^ . 


28.6 


16.3 


16.4 


30.9 


32.7 


39.7 


31.3 



"} 



Slgnlfl- 
' c^ce 



.ol)8 
.002 
.001 



.003 
.001 



.004' 
.02 



.04 
.005 



.001 
.004 
.004 

.001 



.04 



.04 



18.4 
24.5 
28.6 
28.6 


21.\9 
43.8 
15/1 
19 2 


23.0 ^ 
24.4 / 
26.3 \ 
26.3 ) 


.05 


49.0 


63.0 


. 76.0 


.002 


49.0 , 


64.4 


76.5 


.003 


30.6 
49.0 
0.0 
0.0 


60.3 
23.34- 
0.0 
0.0 


41.5 ^ 
47.9 / 

1.8 ? 

0.5 ) 


.002 



JiO 



Item 



TABLE 24 - continued 

Highest Degree Received ' 



User opinion of results 
Utility: 

Very satisfactory ^ 
Satisfactory 
Unsatisfactory 
Highly unsatisfactory 



Before 
i960 



46.9 
22.4 
10.2 
6.1 



1961- 
1970 



63.0 
*9.6 
4.1 
6.8 



1971^ 
1977 \ 



\ 




Signifi- 
cance 



.01 



N » 128 uses 



Professional Age of Industrial Users 
Highest degree received: 
Before 1960 
1961 - 1970 N « 70 uses 

1971 - 1977 N « 144 uses 

More searches by users in. the highest professional age group requested 
searchesj)y phope. Thisj is similar to the findings by calendar age and 
probably for the same reason. More searches by the older group of users 
were, for facts or procedures and more searches by the older group of users 
went back further in time as reflected by heavier use of CHEM7071. The 
oldest user group retrieved the fewest references potentially relevant 
and new to them. Thl* might be attributed to a more critical relevance 
.judgment, ^oore specific search statement, or 'perhaps fewer potentially 
relevant citations ^n their searches. Older, users knew of fewer poten- 
tirally relevant and noF i-et^ documents which mf^t either Ty explalnecl 

by lesser familiarity with the literature or better search results. The 
youngest group of users planned to further investigate a larger number of 
the citations retrieved, probably because on the average, a. larger number 
of citations were new and potentially relevant to this group of users. 



12G 



-3 



112 



TABLE 25 

Professional Age of Industrial Users 



Item 



Search request received 
By phone 

User assistance 
Logic supplied 

• Search constraints 
Author 

Type of approach 

Specific facts or procedures 

'Files searched 
CHEM 7071 

Citations 

New references 
0-2 
3-8 
^ 9-18 
19+ • 
Not retrieved 
0 / 

' 1+ ■ , • \ . , 

Investigate further ^ 
0-2 
3-5 ' 
6-12 

13+ ' ^ 



Highest Degree Received 



Before 
1960 


1961- . 
1970 


1971 
1977 


Signifi- 
cance , 


22.7% 


7.1% 


14.6% 


.02 


18.8 ' ' 


,7.1 


20.1 


.05 


4.7 


14.3 


4 9 


09 

• VIZ. , 


50.8 


37.1 


30 6 




39.1 


28.6 


19-. 4 

9 


.002 


33.6 
28.9 
15.6 
21.9 


34.3 
24.3 
17.1 
24.3 


19.4 •) 
14.6 
21'. 5 
44.4 J 


f .001 


53.1 
'46.9 


37.1 
62.9 


37.5 

•62.5 J 


r -02 


36.7 . 
24.2 
14.8 
24.2 


42.9 
20.0 
14.3 
22.9 


26.4 
13.9 
20.1 
39.6 


.02 ' 
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Positions of Academic Users o' - ^ 

Faculty ; N » 108 ' > ^ ' ' 

Postdoctoral Fellows N-= 77 ' ' i:*- 

or research associates ' 4 » 

Graduate Students N » 168 * 

The graduate student (doctoral candidate) uses ^ould be similar to uses 

by younger (calendar and professional age) users | and In several respects 

this Is true. Fewer of the graduate students * uses -were submitted in writing 

More of the graduate students than faculty (but not post-docs) were present' 

during searches and more graduate students interacted during searches. 

Also, searches by graduate students required more negotiation time. Fewer 

graduate students searched personal document collections or had discussions 

with their colleagues prior to requesting online searches. More graduate 

students than faculty but not post-docs searched printed indexes prior to 

requesting online searches. 

Faculty are older in terms of both calendar and professional age and 

have^a broader range of responsibilities than either post-docs or graduate 

'* . ■ 

students. This is reflected in higher- faculty use of the system for teaching, 
preparation for internal meetings, and preparing grant proposals, as well 
as higher use of the system for current awareness. The latter may explain 
the higher number of searches by the faculty with time constraints. More 



of the faculty searches had synonyms suppliedik and more of the faculty 
uses were for specific facts. 

Post-docs and research associates are professionally older than grad- 
uate students but younger than faculty. Post-docs and research associates 
♦ . 

also typically represent an intermediate group in terms of job responsibility. 
This, is reflected in some but not all of the findings, for instance, in 
use of the system for teaching, and grant proposals and preparation for 



^.ntenial meetings. However, post-docs made the largest niim|ber of system 
Uses for publication. ,Mo?e posf-doc uses were precedie^ by manual searches 
of Indexes, possibly an Indication of lower confidence In the online searched 
system. Post--doc users also had more discussions with colleagues, and 
about the same number of searches of personal collections as the faculty 
prior to "the use of the system.^ The lowest use by post-docs of the system 
for jSurrent awareness might be an Indication of this group being ahead 
of theJLitefature in^helr specialty. ' '■ ^ 
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TABLE 26 ' 

~Posltidns~of~^"a"demirc~Use^^ 



Item 



Faculty Post-doc/RA Doct, Candid SlgnXflcance 



Search request> received 
In writing 

User assistance 

Synonyxas supplied 

Search constraints 



63.9% 
4I-.6 

. If:. 7 



Time period 

Primary application 

Teaching 5.6 

Research 87.0 

Type of approach 

Current awareness ^^-^l 

Purpose of use 

Supporting project-facts 45.4 

Preparation for 

Internal meeting 9.3 

Publication 45.4 

Dissertation 2.8 

Grant proposal 16.7 

Sources used prior to search 

Manual search of Indexes 13.0 

Personal collection 44.4 

Discuss wltK colleague 26.2 

Files searched . 

CHEMCON 90.7 

Negotiation time (mlns. ) 

0 19.4 

1 29.6 
2-3 . 13.9 
4+ ' ' 37.0 

User present" for search ^ 52.8 

User Interact! ons with search 55.6 



74.0% 
41.6 
0.0 



1.3 
93.5 



1.3 
27.3 



3.9 
62.3 
2.6 
1.3 

.35.1 
44.2 
33.8 



93.5 

7.8 
32.5 
28.6 
31.2 

79.2 

77.9 



52!4% 



36.5 



13.1 



0.0 
79.8 



13.7 



34.5 



2.4 
10'.7 
39.3 

,0.6 

33.9 
24.4 
15.5 



97.6 ■ 

8.9 
26.8 
31.5 

32.7 ' 

76.8 
78.0 



} 



.■•004 

.02 

.002 



.02 
.02 



.002 

.04 

/ 

.04 
.001 

.001 



.001 
.001 
.004 



.05 

.01 

.001 
.001 
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gosltlons of' Industrial Users 



^ ' ' Supervisors N = ,60 users r ; 

' Non-supervisory N = 285 u^ers 

When a supervisor used the system he was mpre likely 'to request searches 
^ by phone than non-supervisors. He was not lively use it for current aware- 
ness and less for information on. procedures,, apparatus, or methodology. More 
frequent use of CHEM7071, ^he older Chemical Abstracts data base, was made by 
supervisors. This, perhaps, was because more searches for the remembered 
literature were made. If we can assiime that supervisors are older both in 
^ terms o^ calendar and professional age than non-superyisors , then there is 

consistency in the greater lise of the telephone and higher use by these' groups 
of the older literature as represented by CHEM707l^ 



TABLE 27 . 
Positionsof Industrial' Users 



Item 

Search request received 
By phone 

Type of approach 
Current awareness 



Supervisory 
31.7 



Purpose of use 

Supporting project-procedure 

Files searched 
CHEM7071 



0.0 



'38.3 



46.7 



Non-supervisory 

12.6 

10.9 
V 56.1 

24.9 



, Significance 



.001 



.02 



.02 



.002 
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-PHASE-I-— USER- -INTERVTEWS- 



Following the first phase of the project at FSU ancT MTC, interi^iews were 
conducted with selected users. These Interviews were designed to probe 
specific aspects of user reactloas to online searching and to seek evaluative' 
comments and Information that might not appear on the survey questionnaires.. 
These Interviews were conducted during October, and November l^^and a list 
of the questions asked Is included In the appendix. 
Methodology 

The methodology of th? Interviews was to select potential Interviewees 
from the several categories of users: frequent users, early use-dropout 
and non-use. In the case of Monsanto, some members of the original test 
sample laterrbegan to do searching on their own, so that these self-searchers 
were a small sub-group: that was of Interest and several of these persons 
were also Interviewed. Because of the physical distance to the various 
Monsanto facilities, all Interviews with Monsanto users were by telephone. 
Most of the interviews with FSU users, were also by telephone although it 
proved convenient to do three interviews in person. 

FSU interviewees were selected by first grouping the-fifty available 
sample members by extent of use. Potential interviewees from each category 
were selected to represent the three types of users by status, that is, 
faculty member, post-doctoral/research associate, and graduate student. 
A minimum of three persons per category was' chosen, with the total 
approximating twenty percent of the full sample. 

For f^onsanto, all 109 sample users' search records were reviewed for' 
the number of searches performed, the date of first search and date of last 




r:V > • J. 



search. A histogram of number of searches wao-maHe to determine a' cutrbf f « 
level for frequent users. This was determined to be eight searches,f£ve. ,/ 



approximately ten percent of all Monsanto users had eight or more searches. 

' ■ ' - .; ' • ' / ■ ' ^ 
Participant identification numbers were arranged? sequent ially/with'in> use 

categories. Since the desired number of interylewees in each category was^^r^ 
five, the total number of users per category(>^ divided by five to determipe 
the n-th number to be selected. . That is, the nUmber "bf early users was 
29; divided by five gave 6 (rounded); every slkth user number, starting ( 
with the sixth, was selected for interviewing. 

In addition, for frequent use, the two most frequent users were also 
included, no matter what their identification number. For the non-users, ^ 
a further distinction was made before selection between persons who might 
reasonably not have been exp'ected to use the service by virtue of ^ their work 
(administrators, equipment technicians) and those who might— have' been 
expected to use the service but did not dg..^ (chemists-, researchers). 
Sample ^ 

At FSU, thirteen persons were selected as potential interviewees and 
ten w#re actually interviewed (about 20 percent of the participants). The 
others were not available for various reasons. At Monsanto, twenty-two, 
I^rsons (not counting self-searchers)"were selected, and 16 were actually 
interviewed (plus two self -searchers.) Care was taken to insure that all 
user categories were represented by the completed interviews so that the 
type of person not contacted did not bias the*result. 

Because of the ev^uative and subjective nature of the responses, the 
results of the interviews were not coded for computer analysis. However, 
some manual analysis of the interviews was done under several categories. 
Most Helpfal Results , 

When asked what had been the most helpful results of online searching, 
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a majority of the respondents at both FSU and Monsanto said that keeping 
current In the literature of a field, rapidity of access, and time sAved 
were primary benefits. One Industrial user said he did not concern himself 
with keeping current In certain topics -because-he knew he could always get — 
. updated quickly from the^. online search servlc^. This same user also commented 

that when he: got a new project, his "first stbp" was to do online searching.' 
' As one bench' chemist put It, "manual searching can't even compare with online 
searching." One FSU graduate student, a frequent user, said that the rapid 
access and fast Interaction were helpful In checking out even half -formed 
Ideas. Re described the system as like having a "^smart pal" who could ^ 
respond on any topic asked . 

When asked about the effect of online searching on their other work 
activities and on their productivity, most of the users referred to being 
abljs to work on other tasks because of the time saved by online searches. 
Of those at FSU who comment4^ on the effect on their productivity, one 
faculty member said that his productivity In writing had increased ten to 
twenty percent as a result of doing online searches. Another person felt 
his productivity had .Increased but coul^ not be more specific, while a third 
user felt that there had been no effect on his productivity. At Monsanto, 

one be.nch chemist estimated hls"^ productivity had Increased twenty percent 

< 

due to online searching, while others felt that online searches had helped 
or Increased their productivity though to an .unspecified degree. 

One FSU professor said that there was !'no doubt about It," that online 
searching let him make better use of his time. In one Instance he was able 
to complete the preliminary literature search within* several weeks after 
moving Into a new subject area and was able to have a research proposal 
written shortly thereafter. A research specialist at Monsanto said that 
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4JEen getting Into a new researcli^ area, "a couple of hours of online searching 
would save a xouple of weeks library work." Another Industrial chemist 
related~that"Tieniaa~t^ ^rbbTCT 
that could have required Federal government Intervention, Because, of the 
rapid response and scope of the online search, the government office told 
Monsanto to handle the problem because the company appeared to know more 
about the matter than did the government agency. Still another Monsanto 
user recalled a case where online searches brought him to a point where 
he was conversant on a topic much more rapidly than If he had had to de- 
pend up*on manual searching: "With online It took a month or so; a manual 
^arch might have taken six months to a year," 
System Improvements 

Users were asked about improvements they felt could have helped their 
own searches or the basic search process. At FSU, the comments were varied 
and Included such things as giving written information to users to help 
th6m work out search strategies in advance, being able to' search by compound 
registry number! of chemical formula, having more retrospective files, and 
getting help selecting the right keywords (search terms). Comments from 
Monsanto users were focused on having more retrospective data JL'^ the files 
and' on finding It difficult to select suitable keywords. Perhaps the most 
frequently mentioned problem area from both groups was the Inability to 
select keywords to produce a precise search. 
Expectations 

When asked about their expectations regarding online searching, most 
users at both Monsanto and FSU seemed to have had no preconceptions and 
generally felt that there were no "surprises" to the system. A few found 
the system easier to use or more effective than expected. At FSU only one 
respondent (a frequent user) had expected the system to be easier to use 



than dt proved to be. (Her expectations may have been somewhat unrealistic 
In that she expected to walk In and "push a button" to get her answers.) 



•^At Monsanto one person (a frequent user) was "somewhat disappointed" In 
the, system, primarily from not getting enough relevant citations during 
prec^e searches. But most of the Industrial respondents rep9rted no 



surprises or found that It wo^^d much better than expected. ^ 
Most useful periods 



One aspect of literature searching generally, and of online searching 
in particular, is when, du^i^^ig the course of a project, it is most likely 
to be done. It would be logical to assume that literature searching is 
needed and^^eful at the beginning of an activity, as the researcher is 
^ seeking :to learn about the topic. A clear majority of users at both FSU 
■ and ^Mdnsanto stated that this was the case - online searching is very useful ^ 
in the early phase of work. Some others also corimented that they used 
online searches toward the end of work when writing up results and double- 
checking to Insure that no perblnent references had been overlooked. A 
few respondents noted that they Used online searching at different times 
throughout the life of a project for updating and for searching for 
specific materials. One FSU graduate student said he liked to explore 
sudden interests via online "to keep ideas rolling." 
Proxy searching 

It was recognized that the Immediate user of an online search may not 
be the only beneficiary of the results; other users and some non-users may 
benefit at second hand. At FSU and Monsanto about half of the interviewees- 
said they had shared their searches with <^thers or had used searches done by 
Others. The remainder either had not shared their searches or had not used 
searches done for others or could not recall. This simply^ Illustrates that 
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the value of a*^ online search system extends beyond ,the circle of Immediate ' 

users. One FSU user reported that he did a -search which was shared by ' 

_ ^ . : ^: 

all the other persons in hfs laboratory. A faculty yember commented that 

he had sent copies of. his se^if^ch^esults to a collaborator at a university 

in a Western state. 

End user-dropout ' /I ' • 

A fairly distiuG^^oup eJf users, according to search records, were 
those who used the service iri'^ the early months of Jits availability and then ' 
stopped using it. In i*;few>jca^s, this early use was relatively frequent. . 
For those who used ther^rvicer^and^ then stopped, the primary reasons men- 
tioned were: the person had ^un^What Jie was looking for and had no further 



need for literature seaflrching^.hj^had been' disappointed and not found what 

Ld 

a. 



' ■ / 

he wanted and therefore. concluded the system could not help him; or, mainly 
for Monsanto users, he had moye|I ^nto a different type of work which did 
not require literature searchS&g^ i 
Non-users .^^^^ ■ - ' 

Not everyone to the^academic and industrial user samples made use of^ 

'-^t -7. ' — — ^ ^v: 

the online search servfc^ Individuals simply felt no need - to do extensive 

literature searching at the time the service was available.. . Inertia and 

the pressure of work were the main reasbns for non-use by others. A few 

were skeptical of the value of online searching and seemed content with 
^ ' " ■ ., ■ 

their existing information styles and search habits. 

At FSU the four non-users interviewed reported variously that they 

were doing other work and had no time for literature sjiarching, had no need 

for literature searching, or depende^^ upon their own manual search methods 

and filing isystems. Monsantb non-users most often spoke of bein^ transferred 

to other types; of work not requiring literature searches, or depending upon 



co-workers to do the needed searching 
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These comments (at least by the academic participants) are paralleled 
In a survey of academic non-«-users of a computer retrieval system at^the 
JLnlYer8ity_^^ 



reported a variety of reasons: no need for It; did not know about It; 
relied on a small core of journals. Hdwever, In the view of the authors, 
"the postulated reason [for non-use] - 'Ingrained research habits' - can 
Still be considered as a key reason." (J.K. Martin and R.G. Parsbns, 
"Evaluation of Current Awareness Service for Physics and Astronomy Literature," 
Journal of the American Socfety.for Information Science 25:156-161 (1974)). 
Self searching 

After the Interviewing had beStk underway for some time. It was felt 
that It would be revealing to obtain comments on the value of being able 
to do self-searching at the terminal. This relates to the question of 
the role of the intermediary in the search process. While not all inter- 
viewees were asked this question, enough responded to provide some comments 
of Interest. ^. 

Two of six FSU user respondents volunteered their interest in self 
searching. At Monsanto about half of the users said they would like or 
prefer to do self searching, while the other half said they would prefer 
not to. Of those who preferred to have an information specialist do the 
the actual searching, the* reasotis most often mentioned were that it would 
otherwise take too much of the researcher's time, and the specialist could 
do the search more efficiently because he worked with the system all the 
tlme^ whereas an Infrequent user would not use It enough to be able to do - 
efficient searches. 

.J. Of those Interested In doing their own searching, reasons mentioned 
included the belief that It was difficult to explain search terms to another 
person (the Intermediary), or that the researcher would probably spend more 
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time searching a topic than Vould the /intermed^^iig?> 

iPaiil.G^nn, manager of the Monsanto technical llljrary at Pensacola, 



commented on self -searching at Monsanto. J^t was Initiated by a department 

4 

director who believed, that effective research. and development Is greatly 
enhanced by gopd use of the technical literature. Gann said that some 
chemists were, comfortable- at the terminal and easily comprehended Inter- 
acting with the computer, while others would "freeze." The training of 
these self searchers was limited to'^s^e or two data bases for any one user, 
and, noted "GamT, "differences In search procedures and data base formats 
beqome major obstacles to these people." (P.W. Gann, "On-Llne Searching 
at Monsanto Textiles Company," paper presented at Technical Information 
Users Council meeting, Raleigh, NC, April 28, 1977.) 

Mr. Gann said that he trained approximately a dozen chemists and 
chemical engineers to do their own bibliographic searching. Of that number, 
about six had actively used^ the system ot^ their own and fhree of those 
were fairly frequent. However, self-searchlngs were done a couple of times 
a month at mpst. 

The self -searching resulted from a meeting , of Gann and the heads of 
chemical research at Monsanto, In which Gann described the system and his 
belief that self -searching would not be too difficult and that the library 
would train anyone who was Interested. The directors then encouraged their 
chemists to take the training. ' 

The first group of self-searchers was trained In May 1976 and several 
other groups were trained later. Training consisted of lectures and "hands- 
on" experience In small groups of two or three persons . Some of the chemists 
began searching right ^ay; others were very Interested but did not follow 
through. Gann periodically sent out followup memos to remind and encourage 
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those he had trained, and held follovup training for both new and experienced 
users. 



All of the Searchers were from the chemical research and development 
laboratories of the Monsanto plant. These people were located In their own 
building and Ijad their own terminal (a Texas Instruments 745) and microfiche 
^ Index files of Chemical Abstracts and Engineering Index . Chemical Abstracts 
on microfilm was located adjacent to the online terminal. 

.Of thr ee self searchers who made the most use of the system, two were 
interviewed. One said that he actually preferred to have an Information 
specialist do searching when possible. This user estimated that he himself 
did about twerity-rf Ive percent of his searches, mainly because he thought 
he could do/^^(t^aster and he enjoyed the Interactive process. He found 
that the system was 'Very simple to use" once you learn It. He did say 
that for self -searching, one must do It frequently to become adept, and 
he thought the Inherent complexities of the system meant that It would 
always be preferable to have an Information specialist around. 

Another searcher made the point that he liked to do his own searches 
If he could do them often enough but that Infrequent searching meant that 
^he forgot how to use the system effectively. He thought It would be helpful- 
to have available a brief summary of the mechanics of searching as a way 
of -refreshing his memory. For occasional searching, he preferred to let 
a specialist do It. , . 

In both of thes^ca^^i^ ^e^f-searchlng was done no more often than 
once every three to foi^^^Hs. The experience of ^ academic self -searchers 
during Phase III of this project Is given elsewhere In this report. 
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' PHASE II: HALF COST, MEDIATED SEARCHING 



Phase II of this project was conducted only at JFSU and lasted from 
; \ ; ■mld;-Optober 1977 to late May 1978, This phase concentrated on the effect 
: / of user fees on interactive searching.' About one-half of the cost of the 
s^arch^s was charged indirectly to the users. During this phase the poten- 
.tial user population was extended beyond the original sample to encompass 
all faculty and graduate students jof the Chemistry Depiartment - about 140 
in number. Embedded wlthii^ this phase was a 33-day period of non-mediated, 
'V ■ ' np-cost searching, described later. . ^ 

Indirect User Charges 
r ' ' • An agreement with the FSU Chemistiry Department permitted ijepartmental 
" ;f unds to be used to pay for one-half of the computer connect time and for 

the offline citations printe(^. Users could make charges to various project 
^ grants within the department or, in certain cases, to departmental , general 

funds. Direct payment by users was not accepted. When they came for searches, 
users were told of the arrangement, asked how the searches should be charged ,\ 

\ ■ . •■■ . ■ ■ ^ \ 

and the resulting records were provided to the departmiental business office \ 
for charging to appropriate accounts. The actual searches were still nego- \ 
:^iated and performed by the information specialists. ^ \ 

Sample 

The potential user population, as already mentioned, consisted of all 
Chemistry Department faculty, post-doctoral and research associates , and 
graduate students. This potential user population included 33 faculty mem- 
. bef|,.24 post-doctoral and research associates, and 84 graduate students. 
Of that number, 55, or 39 percent, used the service during phase II.- 
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It Is Interesting to contrast those phase II users who Had also uped . 
V...- . .. ■ ; j ■ 

the servi ce, during - phase I, w ith tho se users who* w er e n ow a tt racted t o: the 

service for the f£rst t;^e. The^fijiaflie I'^iselrs include those who were parti- 
cipants in the study sample <and those non-sample users who received service 
when it did not conflict with searcheS'.Jor sample users. These -non-saimple 



phase I users must be recognized because their exposure to the servic4 may 



have influenced their use or non-use of it during phase' II. 
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Phase II Search Service Unique Users 

I' 

Original Non-sample 
Sample Prior Users 



New 
Users 



^1 

7 

Total 
Unique 
Users 



Faculty 


12 

/. 


1 


3 


16 


Research Assoc/ 
Post-Doctoral 


■ 2, 


2 


6 


10 


Graduate|0_ 


7 • . 


12 


10 


29 


Other 




'1 


1 


2 


Totals 


21 


16 


20 


57 



Of the total unique users during phase II, 37 percent were from the 

original phase I sample while 28 percent were non-sample people with phase I. 

search experience. Thus, almost two-thirds"of the unique users during phase 

•> ' ■ ■ ' _ 

II had prior experiencec^with the service. * 
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Test Instruments 

To gather research data for phase II, the information specialist's Record 
of Online Use was modifl^ by the addition of a question which asked how the 
requested search was to be charged. Foiir response options were given: user's 
own grant,. major professor's grant, departmental funds, and other. 

Since the potential user population had been expanded, demographic data 
had to be collected on first-time users of the service. This ^was done by 
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Interview during the Initial visit and this data, along with a record of 
all searches, was maintained for each user. . ^ 

Procedure 

The manner In wHlch search service was provided remained essentially 
unchanged from phase I. The location of the terminal and the hours ^of op- 
eration remained the same. A different type of terminal was Installed but 
^Ith the saie spe&f^as the prior unit. Announcement memos were sent to all 
potential users and a special presentation was given at -a department seminar 
early In phase II to explain the service and answer questions about It. 
Infotmatlon on Individual searches ^nd on user reactions was gathered In 
the same manner as In phase II 
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Comparison of Half-KIost and Free Mediated Searches by Academic Users 

Half-cost mediated sear\:hes " N • 155 - 

Free mediated searches^ N » 353 

For each of the 155 half-cost uses, records were kept of* use and of 

user feedback. Comparing these data with those of free mediated searches, 

fever half-cost use requests were submitted In person and fewer were sub- 

jmltted in writing y while more half -cost search requests Vere submitted by 

other than the final \xser of the Information. " ' 

It seems that the person In a position to pay for the searches la less 

likely to have time either to come to the search office or to submit his 

4 

question In writing. More half-cost users either did not negotiate or took 
more time (4 or more minutes) to negotiate. There were fewer modifications 
but more continuations of half-cost searches, possibly because of the greater 
experience of the half-cost users. Hpre half-cost users supplied synonyms 
and search logic, probably because of greater Interest In search efficiency. 

Fever half-cost searches had autHor constraints, more date constraints. 
Again the cost factor may have been responsible for the difference. Author 
searches which are done efficiently In printed Indexes were probably done with 
such Indexes Instead of paying for them In online searched systems Data 
constraints as a method of reducing size of output and therefore cost were 
used more extensively. 

More half-cost current awareness searches were made. Also, more half- 
cost searches were made to learn a new specialty, to support ongoing projects 
vlth\heory, facts, procedures, apparatu||^ or methodology, and to prepare 
Internal reports. Half -cost searches required less computer connect time 
(a charge assessed to the user), but more pdst-search staff time. More 
half-cost users Indicated that not enough/citations were retrieved but more 
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half'Cost users were satisfied or very satisfied with the currency and utility 
of the search output » an internal inconsistency. 

Perhaps equally interesting is the absence of significant difference 
between balf*cost users and free users for the other aspects of the search, 
such as purpose of use of system and information sources used prior to re- 
ques^f^ng online search* 
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TABLE 28 

Comparison of Half-Cost and Free Mediated Searches 
by Academic Users 



Item 

Search reqoest received 
In writing 
In person 
By phone 

By other than final user 

Relation to prior searches 
New search 
Continuation 
Modification 

User assistance 
Synonyms suppll 
Logic supplied 

Search constraints 
English only 
Author 

Publication type. 
Maximum number 
Time period 

Primary application 
Teaching 

Research >^ 
Other, course related 
Other^ not course related 



Free 
Mediated 



60.6% 
91.2 
0.0 
7.9 




69.7 
11.6 
15.3 



43.3 
22.4 



0.8 
19.8 
0.0 
1.7 
11.3 



2.0 
85.0 
2.8 
8.5 



Type of search 

Current awareness j, 12.7 
Exhaustive 49.6 
A few references, browsing 22.1 
Specific facts, procedures 13.9 



Half -Cost 
Mediated 



41. 7Z 
^ 80.1 
0.6 

- 14 rl 



70.5 
19 
5 



57.7 
31.4 



1.3 
9.6 
0.0 
.6 
20.5 



2.6 
85.3 

2.6 
' 3.8 



26.9 
42.9 
14.7 
14.7 



Significance .05 



.0001 
.0007 

.05 



.002 



.02 
.04 



.01 ^ 



,009 



.0002 



J +6 
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TABLE 28 - continued 



Item 



Free 
Mediated 



Half -Cost 
Mediated 



Significance .05 



Purpose of use 

Stay current, own areas 52.7 
Stay current, related areas 16.7 

Brushing up 8*8 

Learn new specialty 19.8 

Support project -theory 18.7 

Support project-facts 36.3 
Support project-procedures 24.6 

Preparation for 

Internal meeting 4\8 

Internal report 0.8 
Publication ^ ' , 32.6 

Dissertation 20.1 

. 'Grant proposal 5.7 

Testing system 0.3 

Other J2.7 

Sources used prlortto search 

M anua l search of Indexes 27.^ 

Online system aids 0.^8 

Personal collection 34.8 

Discuss with colleague 22.7 

Negotiation time (mln.) 

0 11. 9L 

1- 2 28.9 

2- 3 % 25.5 
4+ , 33.7 

Files used 

CHBMCON 94.6 

CHBM[7071 24.9 

COMPENDEX , 0.3 

Others 6.2 

Citations printed offline ^ 36.3 

Terminal connect time (mln.) 

1-7 22.1 

8-13' 28.3 

14-23 24.6 

24+ 24.9 



58.3 
18.6 
12.2 
36.5 
43.6 
59.0 
44.9 



7.1 
4.5 
37.2 
19.2 
5.1 
0,0 
5.8 



36.5 
0.6 
42.9 
27.6 




26.9 



39.1 
28.2 
17.9 
"14. 1-' 



.0001 



.05 



.0002 



c 



ERIC 
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TABLE 28 - continued 



Free Half rCost 

Mediated Mediated v Significance 



Post-search staff tline with user (inln> ) 

1-2 25.5 10.9 .0009 

2+ ^ 13.0 . 17.3" 



User opinion of dotations 

Number retrieved 

About right .68.3 68. 6 n 

Too many , 7.1. 7.7 f .007 

Not enough \ 13. 0 19.9 

CiTrrency 



Very satisfactory • 43.9 44.9 

Satisfactory 43.1 46.8 

Unsatisfactory 1.1 1.9 

Highly Unsatisfactory 0.^ 1.3 

Utility • V 

Very s^is^actory , 53.8 53.2 

SatisfrfS^j' 24.1 33.3 

Unsatlsfactdty,. ^ 7.6 5.8 

J Highly Unisatlsfactory^ ^o4.8 « v ' 7.1 



.003 



,001 



Er|c U2 
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PHASE III: FREE NON-MEDIATED SEARCHING 



4 

For a 33-day period within phase II (February 1 through the end of the 
academic quarter on March 17,, 1978) , FSU users were offered the option of 
doing their own interactive searching at no charge. UseN^s desiring to do 

this aelf-searciiing were given an orientation to the system and Shown the 

« ■' ■, . , ' 

basics of searching. All other features of the service remained the/same, 
and users could still request mediated half -cost searches if they wished. 

•During this period two aspects of online searc|iing were in contrast: 
•the no-cost aspect would presumably attract users, while the need to ieam 
about the system and to become directly involved with the terminal^ might 
be a deterrent. What would be the response? ^ 

.■ " . '■ ■ y • ' ■ ■ ~, ■ ^ 

Response ' ' , . - 

would be accurate to say that the response was tvery j)Ositiye. In 
the prior three and a half months of service, 44 unique users had requested 
119 searches. In only a month and a half of self-searching, 44 unique users 
took advantage of .this option and performed 87 searches. Of these 44 users, 
24 of them were new to the search service. .In other words, more than half of 
the users were apparently attracted to do online searching by the combination 
of free use and direct involvement. Only three persons requested mediated 
searches during this period. ^ 

User Population ' 

Of the 44 persons who elected to do their 0wri online searching, 32 
(71Z) were graduate students. Seven research associates, two faculty members, 
and three other persons also did their own searching'. Compared to the half- 
cost mediated phase, more graduate students and fewer faculty members chose to 

ERIC Ub ^ 
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do their own searching. While two faculty members did self-searching, 
three other 'faculty members during that same period requested mediated 
, sear'c^P^* 

. Comparison of Free Non-Mediated with Free Mediated Use 

In this section, a profile of the 87 non-mediated uses In the academic 
environment Is given. For each of the 87 uses, a record of use and a feed- 
back form, the same records as for the mediated (conducted by Information 
specialists) searches, were filled out. The records for the 87 non-mediated 
searches were then compared with 353 mediated searches conducted in the 
acS^jCdemlc environment. 

Less than a fifth of the searches were submitted in written form, a 
significantly smaller proportion than that submitted for searches to be 
done by the information specialists (the mediated searches). This may , be. 
bpcatise such searches are less well thought out than mediated searches. 
All but a small nunier of searches were made by the final user of the search 
results. Three-fourths of the searches were new searches; the remainder 
were equally divided between search modifications and continuation of pre- 
vious searches. 

The user supplied synonjnns for over a third of the searches. Search 
logic was supplied for over a third of the searches, a higher number than 
for mediated searches. The searches for which users did not supply search 
logic were either 'sli|gle concept searches or searches for which the infor- 
mation specialist, present during each search, supplied t;he search logic. 

Only about one out of 20 searches had an "English language references 
only" constraint. This was higher than for mediated searches. About one 
out of five searches had author constraints with the author being either 1^ 
the only access point or an additional access point. About one out of 20 
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. seifches had a time period constraint . Other specified constraints were ' 

I . . 

by Chenrffcal Abstracts sections or for review articles. v ' 

The primary application of search results was for research In about 
nine out of ten uses. The remaining uses were either ^Irectly or Indirectly 
related to teaching or course work. More course-relat^ed use was recorded 
for non-mediated than mediated uses p^haps because thls j type, of use Is 
better done on a self-search basis. The Instructor ma|r not know exactly 
what he Is looking for, an4 may thus prefer to Interacl |lth the search 
output. The purpose of about a fourth of the searchea;was for current 
awareness. This Is more than twice the number of uses - recorded for mediated 
searches. About half of the searches used the exhaustive approach, about 
one fifth used the "few references on a topld" or browsing approach, with 
the remainder of the uses being for specific facts or procedures. About 
two-thirds of the uses were to stay current In useriB ^ areas of Interest 
while about a fourth of the searches were to stay c|irrent with related 
areas. Compared to the corresponding records of mi&lated searches, more 
non-mediated searches were for brushing up (about one-fifth), for learning 
about a new specialty (close to one-half) , to look for theoretical work 
(about one-third), for facts (about half), and for procedures, apparatus, 
or methods (about a third). More than one application of search ifesults 
was checked In a number of Itistai^ces, * — 

The more extensive use of the system for the purposes listed In the 
non-mediated uses may be accounted for by the experience the self-user had 
as the recipient of mediated searches. :it may also be due to different 
needs within the user's research project time frame. About one out of 15 
uses was for preparation for Internal meetings, about one out of 20 for 
preparation of Internal reports" (a larger number than for mediated searches) 
and about one out of five for the preparation of a paper! or a publication 

145 ■ 



(lower than for mediated searches). Fewer non-mediated than mediated uses 
were for work on dissertations (one out of ten) and for work on grant pro- 
posals (only one Such use)© One use was made for preparing a technical 
report. The difference b^tyeen^on-medlated and mediated useg^may be du^ 
to a lesser need for that type of use during the period of non-mediated 
searches and to a different mix of faculty/student users during the two 
phases. There were more students than faculty In Phase III than In Phase I. 

Manually searched Indexes were used prior to online searches In almost 
half of the non-mediated seai^hes. This Is a larger number 'df uses of 
printed Indexes than preceded mediated searches . ^ ^Ijjiost half of the nori- 
medlated searches were also preceded by searches 'In personal collections of 
documents and by discussions with colleagi}es, a hlgheif use o^ these Infor- 
mation resources than for mediated searches. These differences may be ex- 
plained by the lower ♦confidence of the user In his ability to retrieve 
potentially' relevant documents. 

Online system searching aids, such as lists of ke3^ords, were used 
for about one out of five searches by the final user of the Information, 
agalxt a lilgher number of uses than for mediated searches. Non-mediated - 
searches, with one exception, made similar frequency of use of different 
""data bases. CHiMCON was used In more than nine out of ten searches, fol- 
lowed by CHEM7071 which was used In about one out of four searches. The 
next data base In terms of frequency of use was BIOSIS, used In about one 
out of six searches. The BIOSIS data base was probably used less for mediated 
searches because it was not available 't)nllne at the beginning of the study. 

While the number of citations printed online and the number of times 
offline printing was used did not differ significantly for non-mediated 
and mediated searches, there was significant difference in both number of 
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•search statements and connect time per search. More search statements and 
connect time per search were used for non-mediated than mediated searches. 
This may be explained by greater Complexity of self -searches . A more likely 
explanation Is the lesser skill of the self -^ser as compared to the In- 
formation specialist. Significantly less post-search staff time was required 
for non-mediated searches. Whether or not this savltig In personnel- time 
Is offset by the Increased computer connect time Is hard to say, even assuming 
that all other things are equal - which they are not. -^ f.^ v. 

About one out of six non-mediated searches had technical; prbblirasi^ ^ ^ 
This Is not s^lgnlf Icantly different from mediated searches cGnduct^^ 
(The tioxk^edi^ted searches were done In 1978 while the mediated searches 
were done In During the non-mediated phase the system had been 

In operation longer than during the mediated phase, so that some of the 
"bugs" might have been eliminated. Fewer non-mediated searches had log-on 
and TYMSHARE problems, the latter being explained by more frequent use of 
direct dialing to SDC In lieu of using TYMSHARE. 

Non-mediated searches retrieved a larger number of citations than 
mediated searches but were not different in terms of niimber of new or pre- 
vlously familiar citations, kno^^relevant and not retrieved citations, and 
citations to be Investigated furtlier. 

Self -searchers were about equally satisfied with currency of search 
output as recipients of mediated searches (about 86% searches were satis- 
factory or very satisfactory) . There wa^ no statistically significant 
difference in perceived utility of search results between the two groups 
(about 78% of mediated searches were considered satisf acto^r/or very 
satisfactory and about 9 out of 10 non-mediated searchesxfell in these two 
categories). Significantly more mediated than non-mediated searches (about 
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68Z versus 56%) had the "right amount" of output^^^^lTiaicated by the'.u^ers 

- ^ ..... •■ •• -'^v 

of the search results. This may be a tef Ic^lldln^of greater skliljjpf the 
Information specialists In coming up, vl^^^^^slred search results. 
Inexperienced Self -searchers ^ /f 

It should be pointed out that the records of self-seatthlng covered 
a shorter time period than the re'cor^s of Information 'specialists' con- 
ducted searches. Differences may thus b^ a reflection of both the Inex- 
perlence of the^ self -seai^hers and the shorter time span observed. Never- / 

:. ■ ■ ■ : / 

theless, we have not collected' convincing evidence that the final u^er of the 
l|iformatlon cannot do his own online ^fi^rchlng If he so 'desired. Whether j- 
or not this Is the most efficient mode pf operation Is another matter, andA . 
one that can be argu^^^^^^^^s . 
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\ ' Free, Mediated and Free, Non-^ledla^ed Searches 

In the Academic Environment 



Item 



% of Searches 
Mediated Non-Mediated 



(significant data onl>() 
N"353 . N-87 



Significance .05 



Search request received 
In writing 
By. non-final user 

Relation to previous searches 
New search 
Continuation 



Modificafion 



60.6 
7.9 



69.7 
11.6 
15.3 



17.2 
6.9 



74.7 
11.5 
11.5 



User assistance 
Synonyms 
Logic supplied 



Constraints • 

English only < 
Author 
Time period 
, Other restrictions 
" , CA section 
Rev. art. 
All other. 

Primary application 

Research " 

Other applications 
Not course related 
Course related 



43.3 
22.4 



0.8 
19.8 
11.3 



8.5 
2.8 



41.4 
40.2 



4.6 
19.5 
4.6 

^1.1 
2.3 
. 1.1 



bI.1 



4.61 
12.6 J 



.002 
.05 



.001 



Type of search 
' Current awareness 
Exhaustive 

Few references on topic 

or browsing 
Specific facts or proc. 



12.7 
49.6 

22.1 
13.9 



28.7 
50.6 

21.8 
12.6 



.001 



^49 
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TABLE 29 - continued 



Item 



Purpose ^of search 



% of Searches 
Med la t ed^ Non-Med la t ed 



Significance .05 



Stay current:. In own areas 


52 


.7 


62.1 




Stay current In related areas 


16 


.7 


24.1 




Brushing up . 


8 


.8 


19.5, - 


. . .008 


J Learning new specialty 


19 


.8 


43.7 


.001 


Theory , 


18 


.7 


36.8 


. 001 


Facts 


' 36 


.3 


56.3 


.001 


Procedures, apparatus, methods 


24 


.6 


41.4 


,003 


• 

Preparation for 










Internal mfeetlng 


4, 


.8 


6.9 




Internal report 


. 0 


.8 


5.7 . 


~70p9 


Publication or paper 


32 


.6 


20.7 


.05"^ 


Other apprdaches/purposes 










Dls^rtatlbn 


20 


.1 


10.3-1 " 




Grants * 


5 


.7 


1.1 y 


' .002 


Testing system 


0 


.3 


0.0 j 




Other 


12. 


7 


. 11. 5-' 




Sources used prior to search 










Manual search of Indexes 


27. 


§ 


. 42.5 


.02 • 


Online system aids 


■ 0. 


8 


18.4 


.001 


Personal collection 


34. 


8 


47.1 ^~ 


.05 


Discuss ylth colleague 


22. 


7 


43.7 


.001 



Files used 
CHEMCON 
CHEM7071 
SSLE 

All others 
AGRICOLA 
BIOSIS 
GRANTS 
. GDI 
More than one 



0.3 
1.1 
0.8 
0.3 
0.0 



95.4 
23.0 
1.1 

0.0-) 
16.1 
0.0 
1.1 
4.6 



.001 



Search statements 

No. of search statements 
.1-3 
4-7 
8-12 
13+ 



28.0 
26.6 
24.4 
21.0 



14 
28 

24, 
31, 



n J 



.02 



Citations printed online 
0-3 

4-10 \ 

11-20 

21+ 



ERIC 



26.1 
23.8 
24.9 
25.2 



14.9 
28.7 
26.4' 
29.9 
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, TABLE 29 • continued 

• / 

% of rSearches 

ItSl ' Mediated Non-Med:^ted Significance .05 

^_yi J \ . 

Citations printed off-line • 
0_ ' . ' 58.6 

_ 1+ , 41.4 

^^^^ 

Tennlnal connect time (mln.) 

1-7 22.1 11.5 

8-13 - 28.3 19.5 

14-23 . 24.6 24.1 ' 

24+ / ' . 24.9 44.8 

Post-Terminal staff time (mln. ) 

• / 1-2 - 25.5 

2+ • ^ 13.0 2.3 .001 



/ ■ 

4'roHlema 

/ Techi^cal problems 16.1 
LogTon 10\8 2.3 

o.a 



TTf^HARE 9.6 



Citations 

Number' retrieved 

^ 0-8 V 24.4 18.4 

9-23 . . 25.5 ^25.3 

24-65 ' ^ 31.4 " 23.0 

'66+ 18.7 33.3 

Familiar prior' to search " 

1-2 ' 19.5 . 18.4 

■3-6. ' 19.5 17.2 

7+'.- 30.3 31.0 
New references 

0-2 ' • ■ ^ 26.9 27.6 

3-8 24.4 23.0 

' . 9-18 19.8 ' 17.2 

.19+ . • . ' 28.9. 32.2 

Not., retrieved " • 

Ta' 1+ . ' ' 41.9 48.3 
investigate further 

, 0-2 ' - ' 28.6 32.2 

3-5 21.8 25.3 

6-12 21.0 • " 10.3 

13+ 28.6 32.2 

User oplnj ifcn 

Number ■! tat Ions retrieved 

Jus^^ght 68.3 5©3 

' Too many " • 7.1 ; 8.0 

Not enough 13.0 31.0 



ERIC 
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. TABLE 29 - continued 

P % of Searches 
-Itsi _ -Mediated - Noa-Medlated- . — Significance — .05 



User opinion (cont,) 
Currency 

Very satisfactory 43.9 33.3* 

Satisfactory 43.1 52.9 

Unsatisfactory 1.1 5.7 

Highly .unsatisfactory 0.3 0.0 
Utility 

Very satisfactory 53.8 54.^ 

Satisfactory 24.1 33.3 

Unsatisfactory 7.6 10.3 

Highly unsatisfactory 4.8 1.1 
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EFFECTS ON INFORMATION STYLE 



Hence, as regards research design, this study largely parallels the 
analysis reported a decade and a half ago by Resnlck and Hensley^ on 
the effects of a manual Selective Dissemination of Information (SDI) 
system for researchers ^in a business research center, as well as the 
studio with a traditional experimental design now underway by 



A. Resnick and C. B. Hens ley, "The Use of Diary and Interview 
Techniques in Evaluating a System for Disseminating Technical Information," 
American Documei^ation .. 14 (1963), pp. 109^116. 



ERIC ^ ^ .^i^3 



In t^ preceding sections of this report, we have reported detailed 
analyses of the characteristics of users and noausers (and early and 
late users, and high and low frequency users), and of the characteristics 
and applications of searches, for an online b'ibliographic search system 
Introduced in both an ^industrial and an academic environment. These 
analyses build upon a parallel, relatively substantial -body of literature 
and .in many respects, confirm earlier -results based \on other samples 
from other work settings. 

The ^bjectlves of study and the mode of analyses repor^^ in this \^ 
section, on the other iiand, are substantially new analytical^ results 
not generally heretofore reported in the literature. That is, this 
section focuses on the Impact of use of online bibliographic searching 
on changing the "Information style" of scientists and technicians in 
both an industrial and an academic setting. Such study requires a 
longitudinal' analysis , with test-retest assessment, and with quasi- 
experimental design (i.e., experimental "tr^atioent" and control groups). 
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Gerstenfeld and Berger. The present study, however, entails a signifi- 
cantly larger sample, a longer time period prior to reassessment 
(approximately one year), a more comprehensive set^of variables for test 
and retest, a less structured experimental design entailing a self- 
selected "control" group, and, of course, a different "treatment," 

viz., the Introduction of the rapidly spreading utilization of online 

3 

bibliographic searching services. 

In this section, our general working hypothesis Is that the ex- 
posure to and use of online bibliographic searching, with the assistance 
of information specialists, will significantly alter selected aspects 
of scientists' activities pertaining to their Information style and 
Information habits. However, Inasmuch as there Is not a substantial amount 
of prior empirical research on this toplc~nor much significant theory 
beyond conjecture, anecdotal accounts, and P. R. by vendors of online 
bibliographic systems and bibliographic data bases— we did not propose 
dl^ctlonal hypotheses. That is, the*' research is conceived as largely 
exploratory, with changes assessed for a large number on measures 
of . information style, some of which were adapted from earlier studies and 
I some of which were newly developed for the current study. 

Study Design ^ 
The study sample^includes scientists and technologists in two 

distinctly different work settings (industrial and academic), 

* 

/ 

2 , 

A. Gerstenfeld, and P. D. Berger, "An Experimental Design for Im- 
proving the Transfer of Information to Scientists and Engineers ," paper 
presented at the American Institute for Decision Sciences, San Diego, 
March, 1978. 

3 

J. J. Gardner, and D. M. Wax, "Online Bibliographic Services," 
yibrary Journal. 101 (1976), pp. 1827-1832.. 
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as previously described In an earlier section of this report. As also 

• 4 ' * 

noted elsewhere, 2^2 Industrial scientists and technologists, and 70 

_ _ . 

academic chemists, completed both the study pretest and post-test survey 
Instrtiments. They compose the sample* for the present analyses based on 
a comparison of pretest and pos^test responses to selected Items identl- 
i cally repeated on both survey instruments. Of the 262 industrial sample 
members, 108 (41 percent), conducted' online bibliographic searches during 
the first 13 months of the\study, with an average of 3.19 searches per 
searcher (a total of 345 searches for the, 108). Of the 70 academic 
: chemists, 50 (71 percent) conducted online bibliographic searches during 
^ approximately the first year after introduction of the system, with an 

average of 7.06 searches per searcher (a total of 353 searches for the 50) . 

Measures>,^f Information Style 

A large array of items, identically worded for both pre- and post- 
test, were included in the survey Instruments completed at two time periods 
by the 262 industrial and 70 academic scientists and technologists. In 
major degree, these measures of "information style" parallel and expand 
upon the description of information style provided by Rubensteln and 
associates.^ These criterion variables Include meas>ires of (a) change 
in average time spent in information dissemination and gathering activities; 
(b) Change in frequency of use of traditional information sdurces; (c) 

^A*. E. Bayer and G. Jahoda, "Background Characteristics of In- 
dustrial and Academic Users and Nonusers of Online Bibliographic Search 
Services," Online Review , 3 (1979), forthcoming." 

' * . * 

^A. H. Rubensteln, et. al . "Explorations on the Information Seeking , 
Style of Researchers," In C. E. Nelson and D. K. Pollock (eds.). 
Communication Among Scientists and Engineers (Lexington. MA: Heath. 
1970), pp. 209-23l7 ■ , 

• . ■ . • . ■ • IP ' • 

155 ' • 
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change In assessment of the utility of these Information vsources; (d) 

c • ^ • 

changes l^n opinion on selected, aspects of Information searching; and (e) 
change in assessment of the iliportance of selected characteristics of 
various information sources/ Most Items were worded identically for re- 
spondents in both the industrial and academic setting. However, a few| 
items were, added (or deleted) from one* or the other survey Instruments 
because of some intrinsic differences between the two work settings. 



^ 



^ A few other items were slightly modified and improved for the ^cademjLc - ^ 

pretest survey, which was ^administered/ somewhat later than fhe* in^d^trlal ^ 
survey and hence offered an opportui^ity for some ininpr imprdvefaents in ■ \ 



questionnaire wording. Where pariti^cular questionnaire . items were» omitted 

. • " • ■ ■ ■'. V'.'' ' ^ ' ' 

or modified, the data in the following tabula^ pres^ptatidSs^are noted 
by "N.A." (not applicable) for one of tHe two Sample ^iotj^a. .^T^ actual 



e of the two ^sample ^Irotj^a. actual 



q^?!^tion wording, and response alteiniA\:lverf,v&re sli6vn lrf^ K 
to this report which includes- a co'mpletfe ccj^^ the.p^e^ ^" i^ f\ 
^'^^test instruments. - .V^ ' ' ' • 1^"^ ' ^ . 



Methodology V ' . /- ' / ^ ' i 

In an Ideal^contrbllecf Experimental r§rle«ich '(Jm 
are randomly assigned to an iexper 
(non- treatment) group;, ^uch ptoc^^^ 
of extraneous variables itSdepe 



rj^ental' (treatmerir)^ group, or a control 
toc^u^s ^sjBeiitially randbmize the effe^'^:.. }^ - 
ndent cj^he treatment i&rigble. ^ HdwefveVf 



in the present study,^ use .9f9 the ttrea 



ent (e^DSMdyment of ^ oniine se.^ch 



services) was necessarily left voli^tary, and' it V deemed .imsatls-.^ 



factory to attempt to arbitrarily (tandomly) wlttiholii^^ ^ the ' .y:^ , 

search services by a subset of the^ scdenlAsta. aidf^'-technbloglsts ^in the v ^ 
two work settings. Consequent ljr,f^I^ j^^:udy if^ chaifjStcterlz^d as a qijasil ^ 



; experimental design, with self --selection of subjects to the treatment 



or 



non-treatment stimulus. 




■ - ^ - I : L ^ 

This, limitation 'to a quasV-experlmental design affe^tfi-Ehe metho- 
dology of the study, and also Introduces some problems regarding inter- 
pretation of. results. Indeed, earlier research^'^'^ has shown that there 
are some significant differences among adofters and non-adopters of new 
.^innovative liti^ature search capabilities. Indeed, our own study^ 
,^ of users abd nonusers of the present online bibliographic search services 
^tias^ho^ that some aspects of prior information style and attitudes are 

correlates of subsequent use of the , online search services. Hence, in 
• the following analysis, where information style and change in information 
•s^,;,e are the dependent variables, we are aware of the confounding ef^ct 
of this Jvar4^h/l'e€lr the voluntary self-selection to be a user or nonuier 
.,of t^e online Services in the quasi-experimental design. Consequently," 
:;%^,^^6\dlstinct methodological strategies for analysis are employed. 

..(■The first analysis compares the changes on the sets of measures of 
^inlonaat^on style for those who' were online users against those who were 
•not users. ovef the period of the study. The data are also analyzed separately 

. D, T. Curtis, "On-Line Retrieval as an Information Source for Bench 

Bloscientists," OnLine Review . 1 (1974), pp. 279-288. 

^ }'a^arence, -B. H. Weil, and M. H. Graham, "Makinf o'n-Line Search 
Available in an Industrial Research Environment," Journal. of the American 
gpclety^ foTf Informat ion Scientists . 25 (1974), pp. 364-369. '. 

„i Stern, C. S. Craig, A. J. LaGreca, ^nd R. C. Salem, "The 

Effect of Sociometrlc Location on the Adoption of an Innovation within a 
University Faculty," Sociology of Education . 49 (1976), pp. 90-96. 

• ';-;.( '^^^Vayar and Jahoda, op. cit. * 
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for those In the Industrial setting and thcfee In the academic setting, 
with special attention being given to the results which were consistent 
and repllcable across work environments. The statistical methodology In 
this case Is simple Chl-square analysis, where the bef ore-measure Is 
cross-tabulated against the after-measure on each Information style 
variable, separately for users and for nonusers, and by work setting. 

However, we have earlier established that there Is some self- 
selection to the user or to the nonuser group, as a function of prior Infor- 
mation style and preferences. Consequently, /members of the two groups 
do not necessarily begin participation In the study project with equivalent, 
or randomized, status on the pre-test of the dependent variable for 
the present analysis. That Is, a change, as might be detected by the 
cross-tabular analyslj^ could be more a function of the differences in the 
initial (pre-test) measurement level of each" group (user or nonuser) 
rather than attributable to thie^irect effects of use of online search 
services. 

The second methodological strategy, based on linear regression 
techniques, partially overcomes these interpretative difficulties. 
For the regression analyses we have calculated a change score, derived 
by subtracting the pretest value from the post-test value. However, the 

possible range of this change measure for* any given subject is a function 

if' ' • 

of the pretest level on the Initial pretest assessment. That is, on a 

. ■* 

five-point scale, for example, a person who responded "3" in the pretest 

'* ■ ■ ^ 

would have an upper limit of + 2 on the change measure, whereas a person 

> • • 

who responded "1" or "5" could have an upper limit of + 4 on this change 
measure. Consistent with slaiJllttr methodological difficulties with 
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measurement of change,- we have employed the general technique of 



control for initial level of measurement through partial correlation 



That la, we have tabulated the partial correlation between use of online 
services and our change measure, controlling for the pretest value on 
the change measure. This technique also partially overcomes the 
differences in pretest values between self-selected subsequent users and 
non-users of the search services as described above with regard to cross- 
tabular analysis. 

Unlike cross-tabular analysis, the correlational analysis also 
assumes a linear relationship between the independent variable and the 
measure of the degree of change in the criterion measures. However, 
inspection of the cross-tabulations would suggest that such an assumption 
generally holds for the present data. Moreover, the correlational 
analysis also incorporates a somewhat different measure of tl^ independent 
variable. That is, in the cross-tabular analysis only a dichotomous 
comparison is made—between nonusers and all users of the'dnline services 
in the appiroxlmately first year after introduction of the search services. 
In the correlational analysis, the independent variable is continuous, 
a function of the frequency ofe use of the online services over the period 
of the study. Nonusers take on a value of "0". However, among users, 
the number of searches conducted is highly skewed, with a small number 
of persons being extremely heavy users. To prohibit these few cases 
from contributing a disproportionate weight in the regression equations, 
all high frequency users (5 or more searches over the i}||piod) are given 
the same highest code value on the independent variable (amount of online xise) 

^^F. M. Lord, "Elementary Models for Measuring Change," in C. W. 
Harris (ed.). Problems in Measuring Change (Madison: University of 
Wisconsin Press, 1963), pp. 21-38. 

j^-v.. . trio 
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( Results V 

The analysis of results combines assessment of both methodologies 
In drawing conclusions on the Impact of use of ^ online bibliographic search 
services on information style. First, we compare the extent of change, 
and the direction of change, between the users and the nonusers as reflected 
in the cross-tabular analyse^. We then turn to the partial correlation 
analysis, which controls for possible levels of differences in the pretest 
measure for change, to detect parallel substantiating results based on a 
linear model and a more detailed (continuous) measurement of the independent 
variable (useage rate of online searching over the period). Finally, for 
both methodologies, we analyze the data separately for those in the 
industrial setting and those in the academic setting. Consistent with^' i 
our research objectives in preceding sections .of this report, we will be 
particularly looking for findings of impacts of use of online systems which 
are generallzable across both work settings. Given the earlier 'findings, 
however, we do not expeotto uncover a large number of factors which are 
in fact repllleiable across se^ttlngs. - * 

Time Spent in Selected , . * 

Activities >^ \ 

For both the pretest and the post-test surve^^ study participants 
were asked to report the amount of time spent in an average week on 
selected information dlasemlnatlon and gathering activities. Analyses of 
changes in these activities over the period of the study were made for 
the amount of time spent in writing or preparing researcC^ reports or 
professional papers, locating information, reading professional literature, 
and in information discussions with colleagues. 
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In the industrial setting, both" users and nonugers reported spending 
more time In locating ^Informatloi and In writing reports and papers x 
^at the end of the study project than at. the beginning. However, parallel 
changes over time were not reflected among the academic chemists, suggesting 
that some significant changes In the Industrial work setting, beyond 

merely the Introduction of online search capabilities a llk^y were taking 

^ / \ 

place. The cross-tabular analyses (Table 30) do reflect some other slg- 

nlf leant changes In the use of the scientists' and technologists' time 
in the industrial setting which might be related to experience with online 
searching. That is, users reported spending less time in reading pro- 
fessional literature and in discussion with colleagues, while nonusers 
reported spending significantly more time in each of these activities. 
No parallel significant and opposite directional" changes were, however, 
derived for the two groups (users and nonusers) in the academic setting. 

The correlational analyses (Table 31) further specify these 
suggestive relationships. For the academic ch^ttsts, no statistically 
significant Impact of online use on time spent in information dissemination 
and gathering activities was detected. For the industrial group, two 
significant findings were established. First, the more frequent users of 
online searching decreased their amount of discussion with colleagues. 
We would explain this, by suggesting t|[at users now had less need to seek 
out other colleagues for information pertaining to their work. The 
alternative hypothesis, which these data would suggest be rejected, 
would have been that uaei's of dnllne searching would be "information rich" 
and be sought out more by their colleagues for their current knowledge of 
the literature. * 



Table 30. Change in Average Time per week 
Spent in Selected Information Dissemination and 
Gathering Activities: Users and Nonusers of Online 
^Searching, by Type of Work Setting 



Industrial Settin)^ 



Academic Setting 



Direction of Change Sig. Test of Amount ; Direction of Change Sig. Test of Amount 
_it|Ilme ^^ ■■ ■of-Change-Cp-value) in-Time :- -of-Change-(pFvaluer- 

Users Nonusers Users Nonusers Users Nonusers Users Nonu sers 



)r preparing 

:h reports increase increase .03 ,5]/ 



)r preparing K 
donal > ys 



)T preparing 
1 or pro- . 
lal papers 



tion 

rofessional 
ure 

discussions 
agues- 



increase increase N.S, 



N.A. 



N.A. / ,N.A. 



increase increase . . 01 

de- . 0 

crease increase' .001 

de- 
crease increase .01 



.01 



.01 



.001 
.001 
.001 



N.A. 



N.A. 



N.A. 



N.A. 



N.A. 



N.A. 



no no 
change change N.S. 



no 



increase change 



N.A. 



N.A. 



N.A. increase no cl^ange .001^ N.S. 



de- no 
crease change .001 N . S . . 



N.S. 




.02 ' . N.S. 
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Table 3;; . Relationship of Amount of Online Use 
^and Change in Time Spent in Selected Information 
Dissemination and Gathering Activities, Controlling for 
Initial Am^ount of Time Spent, by Vork Setting 



Activity 



,' Writing or. preparing 
research, reports 

Writing or preparing' 
professional papers 

Writing or preparing 
reports 9r professional 
papers 

Locating 
inforiuatlon 

Reading professioofal 
■ literature/ 

I 

Informal discussions 
J with colleagues 




Partial Correlation Test of 



Acadeiic Settin f ^( 



/ , , 'Partial Correlation Testcf 

on rolling for pretest Significance (controlling for pretest Significance 
level on change measure) , (p-value) level^on change measure) ' (p-Le) 



.245 



.064 



n.a. 



.095 



-.008, 



-.118 



.001 



n.s. 



n.a. 



n.s, 



n.s. 



•.05 



n.a. 



n.a. 



-.028 



.021 



.183 



-.062- 



n.a. 



'^■Hj) n.a. 



n.s. . 



n.s. 



n.s. 



n.s. 



Note: On the criterion and control variables, the greater the .time. - 
spent the higher the score value. Change equals post-test 
value minus pre-test value. • * 
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The other significant correlation for, the Industrial sample 
is that users spent substantially more time than formerly on writing 
and preparing research reports. At least two explanations are possible. 
First, it is possible that the use of online searching allows m6*te avail- 
able time for writing as opposed to literature searching. Alternatively, 
perhaps those with the most need to engage in the writing and preparing 
of reports are most likely to- employ online /searching as an adjunct to 
their efforts. .Further research will be needed to ascertain which of 
^ these explanations is salient, or whether both might apply in some joint 
.way. Finally, the lack of i/eplication of this result in the academic 
setting likewise requires further exploration. 

Use of Other Information Tools 

The study design assessed pre- and post-u8e of a large array of 
othet traditional sources of information by users and nonrusers. For 
the industrial sample, 13 means of gathering or locating information, 
other than through onlinii^ searching, were listed; for the academic scien- 
tlsts, 11 other meaps were assessed. As expected, on practically aid 
types" of informatioii sources theje was either no change or a decrease 

by those^who elected to use online bibliographic search 
serT/|^»^(t'kfele 32)/ As also expected, in the academic setting nonusers 
o^ th^nllne services did norif -d^gnificantly alter the extent of their 
use of, any of -these more tradiftflpnal sources of scientific information. 
However, in the indiistrjter fet*^^ even nonusers of online searching 
significantly decreased their information-seeking activities with practically 
all .Information toolp^ again suggesting that the work objectives throughout 
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Table 32 . Change in Frequency of Use of 
■ Selected Infonuation Sources s Users and 
Nonusers of Online Searching, by type 
of Work Setting 



Type 
of 

Informatioa 
Source 



Industrial Settin|; 



Academic Setting 



Direction of Change , Slg. Test of Aaount Firection of Change r Sig. Test of Amount 
ilMIreau^ of Change (p-valuej In Use Frequency of Change tvalue) 

Mrs Nonusers. Users Nonusers Users Nonusers Users Nonusers 



Personal collection 

of iafonaatioo 
Manual search of Indexes 

to literature 
Scanning of abstract 

bulletins 
Scanning in-houset, 

abstracts 
Scanning of abstract 
. bulletins or tables 

of contents ' 
Scanning primary sources 
Library browsing 
Use of citations 

fron other vory^ 
From business colleague 
From Faculty colleague 
Fron.1 student 
From,fri4d outside 
From iimediate supenisor 
From other supervisor 
From technician/ 
assistant 
ttiffl' librarian • 
fm technician 



decrease 


decrease 


.001 


.01 


oecrease 


decrease 


.001 


.001 


decrease 


decrease 


.001 


.001 


decrease 


decrease 


.001 


.001' 


/ 








N.A. 


, N.A. 


N.A. 


N.A. ^ 


^0 change 


decrease 


N.S. 


.001 


decrease 


decrease 


.01 


.001 


decrease 


decrease 


.001 


.001 ' 


decrease 


decrease 


.001 


• .001 


N.A. 


N.A. 


N.A. 


N.A, 


N.A. 


N.A. 


N.A. 


n.a;.;- 


decrease 


decrease 


'.001 


.001 


decrease 


decrease 


.02 


.001 


decrease 


decrease 


.001 


.001 


N.A. 


N.A. 


N.A. 


,N.A. 


decrease 


decrea|e 


.01 . 


.001 


decrease 


increafe 


.01 


.001 





no , 






decrease 


change 


.04 


N.S. 


no 


no 






change 


change 


N.S 




N.A. 


N.A. 


N.A. 


/N.A. 


N.A. 


N.A. 


N.A. 


,N.A. 


decrease 


no 


.01 


N.S.' 




change 






no change 


no change 


N.S. 


N.S. 


no change 


no change 


'N.S. 


N.S. 


decrease 


no change 


.01 


N.S. 


N.A. 


N.A. 


N.A. 


N.A. 


no change 


no change 


N.S. 


N.S, 


no change 


no change 


N.S. 


N.S. 


decrease 


no change 


.04 


N.S. 


N.A. 


iN.A. 


N.A. 


N.A. 


N.A. 


N.A. 


N.A. 


N.A. 


Increase 


no change 


.01 ■ 


N.S. 


no change 


no change 


N.S. 


N.S. 


N.A. 


N.A. 


N.A. 


N.A.' 



^ Table . RelitlQnsWp: of Ajapunt 6f Puline Cm and: ChaMe, . i 
in Frequency pf^Uset.orSekcted Info)iBatlqn Sour^esv'Controll^' 
for Initial , Friiqueacydn Use of Soute, by Vork * ' ' 




Personal collection 

of informtion 
Manual search of indexes 

to literature 
Scanning of abstract 

bulletins . 
^ Scanning in-house abstracts 
Scanning of abstract 

bulletins or tables o! 

contents 
Scanning primary sources 
Library ^rowsing 
' Use of citations from 

other works 
Fi^om business colleague ■ ^ 
From faculty colleague 
From student'^ i/f 
-From friend outside 
From immediate supervisor , 
From other supervisor 
. From technician/assistant 
From librarian 
From technician f 



■Note: On the criierion and control variables, the greater the' 
frequency the higher the score value.. Change equals 
post-test value minus pre-test value. 
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the Industrial setting may have changed dramatically during the course of 
the researcliNfitudy. 

A clearer and more concise summary of the possible Impact of 
K ' online use on subsequent use of more tradltlonaL.xij)iformatlon tools 

Is provided by the correlational analyses (Table 33^. For both the 
Industrial and the academic groups, the frequency of use of online searching 
was significantly correlated with an increasing call on services of a ; 
librarian. Apparently, online searching uncovered a substantial amount 
, * of literature, and prob^ly literature not generalljj directly accessible 

by scientists without assistance, which required greater interaction 
and intervention/ by. librarians. No other significant correlates of 
online use were derived for the academic chemists. However, for the 
industrial scientists and technologists, the more frequent users of online 
searching significantly increased their contacts with persons outside of 
thelr^ employment setting for information, they increased the amount of 
time they tfpent scanning in-house ab^racts, and they substantially ' 
decreased the amount of time they spent seeking literature information 
from their immedilitZB' supervisor. 

Assessment of Value of Other 
Informa tion Tools 

\ 

A second similar listed array of traditional information tools 

as described above was also presented to the study subjects, but in 

this case they were asked to assess the relative usefulness of those 

sources.' Not surprgsingly, those who took the opportunity to use online 

searching services either then deprecated the utility of the other more 

traditional information tools, or did 'not change in their attitude and 

assessment of these other tools (Table .34), As expected, in the academic 

■ . ^ . ■ 
o ' ' ■ ..: . ' ^ ' - 

ERIC ^ ^ -'71 . 



Table 34. Change in Assessment of 
Utility Selected Information Sources: 
Iraers and Nonusers of Online 
Searching, by Type of Work Setting 



Type 
of 

Information 
Source 



Industrial Setting 



Direction of Change Sig. Test of Amount Direction of Change 
In Utility Assess- of Change (p-value) in Utility Assess 
ggPt- ■ ment ' 



T 

Academic Settlny^ 



Sig. Test 
of Change 



of Amount 
(p-value) 



Users 



Nonusersji^ Users 



Personal collectlob 

of Information 
Manual search of 

Indexes to lit. 
Scanning of abstract 

bulletins 
Scanning of in-house 

abstracts 
Scanning of abstract 
' bulletins or 

tables of contents 
Scanning of primary • • 

sources ^ 
LlbrarjT^browsing 
Use of citations ^4 

from other works ■ 
From business 

colleague 
From faculty 

colleague 
From student 
From friend outside 
From immediate 

supervisor 
Frg^ other supervisor 
From tecVn/assist. 
Prom librarian 
From technician 
Online blbli^raphic 

data base 
Computerized current' 

awareness service ' 



no change less 

less less 

less more 

less less 



N.S, 



N.A. 



no change less 
less less 



less 

less 

N.A. 
N.A. 

less 

less 
less 

N,A/ 
less 
no chanj^e less 

more less 
N.A. Ti.k. 



less 
less 

N.A. ^ ' 
N.A. 

less 

no change 
less 
N.A. 
less 



.01 
N.A. 



Nonusers Users 





Nonusers Users 



Nonusers 



no change no change N.S. 



N.S. 



.001 


.001 


no change 


' no ^change 


N.S. 


i« * d • 


.001 


.01 


N.A. 


N.A. 


N A 


N A 

(1 .A. 


.001 • 


.001 


' N.A. ' 


N.A. 


N.A. - 


^» A. 


N.A. 


N.A. 


less 


no change 


.05 


• N.S.. 


N.S.' 


.001 


no change 


no change 


N.S. 


N.S. 


.01 


.001 


no chang^ 


no change 


N.S. 


N.S. 


.01 


.001 


no change 


no change 


N.S. 


N.S.:^ 


.01 


.01 


N.A. 


N.A. 


N.A. 




N.A. 


N,A. 


no change 


no change 


N.S. 


N.S. 


N.A. 


N.A. 


less 


no change 


.01 


N.S. 


.01 


.01 


no change 


no change 


N.S. 


N.Sa 


.01 


N.S. 


N.A. 


N.A. 


N.A. 


N.A, 


.02 


.001 


N.A. 


N.A. 


N.A. 


n.a'. 


N.A. 


N.A. 


no change 


no change 


N.S. %: 


N.S. 


.01 


.001 


no change 


no change 


N.S. . i 


• N.S. ' 


N.S. 


.001 


N.A. • 


N.A. 


N.^.fe-i 


. N.A. 



.001 



no change 



no change 



no change 
no change 




Table 35 . Relationship of Amount of Online Use and Change 
in Assessioent of Utility of Selected Information Sources, Controlling 
»for Initial Assessment of Utility, by Work Sfife^ng 



Type 

• ' of 
>, Information 



Industrial Settinf^ 



Partial Correlation Test of 
(controlling for pretest Significance 
level on change measure) (p-value) 



Academic Settlnf> 



Persooll collection 

ojinformation 
Hanual search of indexes 

to literature 
Scanning of abstract 

bulletins > > 
Scanning of in-Souse 

abstracts 
Scanning of abatpct bulletins 

or tables of contents 
, Scanning of prlnary sources 
Library browsing 
Use of citations from 

other vorks 
From business colleague 
From faculty colleague 
From student , 
From friend outside 
From immediate supervisor 
• From other supervisor 
From technician/assistant 
From librarian 
From technician 

Online bibliographic 
data base 

Computerized current 
awareness service 



Partial Correlation Test of 
(controlling for pretest Significance 
level on chlfhge measure) (p-value) _ , 



.060 

.059 

.083 

.190 

n.a. 
.123 
.063 

.141 
-.001 

n.a. 

n.a. 
-.012 
-.073 
-.071 

n.a. 

.143 
-.078 

.574 

n.a. 



n.s. 

n,s. 

n.s. 

.001- 

n.a. 
.05 
n.s. 

n.s. 
n.a. 
n.a.' 
n.s. 
n.s. 
n.s. 
n.a. 
.01 
n.s. 

.001 

n.a. 



■ .217 



.055 
n.a. 
n.a. 



.176 
.196 
.132 

.241 
n.a. 
-.003 
.057 
.233 
n.a. 
n.a. 
.205 
.158 
n.a. 

.555. 

.087 



.05 



n.s. 



n.a.'jh 



n.a. 

n.s. 
' .05 
n.s. 

,. '05 
n.a. 

n.s. 

n.s. 

.05 
n.a. 
n.a. 

.05 
n.s. 
'n.a.^ 



1 r 



001 



H 

ON 

0 



n.s. 



Note: 



On the criterion and control variables, the greater the assessment 
of utility the higher the score value. Change equals post-test 
values minus pre-test valuesi 
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setting nonusers did not significantly change in their assessment of the 
• .utility of any of the other more traditional resources. Again, inexplicably, 
•in the indiifetrial setting, even nonusers of the online search service 
often significantly reduced their assessment of utility of the more 
traditional means of information seeking (except for the scanning of 
abstract bulletins, which nonusers thought were significantly more useful 
at the end of the study period than they had formerly thought). 
Of the initial array of traditional information tools, the 

A. 

> correlational analyses Indicate that there are only two Which are 

statistically significant and in the same direction in both environments " 
(Table 35). Th^t-^is, the^frpquent users of , online searching in both ' " 
the academic and the industrial settings significantly increased their '^'^ - 
assessment .of the utility of, scanning primary sources and the use of 
citations from other works. The academics who were frequent users also 
increased their assessments, relative to infrequent users and nonusers, 
of tl^ value °of their personal collection of information, friends outside 
of their work setting, and the utility of their technicians or assistants 
as information sources. Iti the industrial setting, more frequent users 
increased their assessment of the value of in-house abstracts and the 
company librarians as sources of information. 

Finally, in both settings the most frequent users of the online 
services could be characterized as enthusiastic ^verts (most of whom 
were initially skeptics) in their assessment^of^ the utility of online 

.<^ 

bibliographic data bases for their work. In both settings, the partial 
correlation between the frequency of use of online search and the pre- 
^° ^^^Z!^^""^ appraisal of the utility Tf qnline searching was ' 
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more than .55 (Table 35). This is the highest correlation coefficient 
tierived by these analyses, and is statistically significant beyond the 
>001 l6vel. This substantial change and apparent enthusiasm fot the 
se^lces offered through this study project clearly explains why both 
organizations, upon completion of the presen|^study, have opted to install 
online search capgbility as a permanent feature in the work setting. 

Assessed Importance of Information 
. Source Characteristics 

In both the pre- and the post-assessment, the study participants 
were asked to rank the importance of various characteristics of infor- 
mation sources on a four-point scale (essential, very Important, so^e 
Importance, not important). Seven characteristics were evaluated local 
availability, up^to-dateness, response time in obtaining a citation or 
abstract, response time in obtaining a full copy of an original document, 
accuracy/authoritativeness, comprehensiveness /completeness, and direct 
useability without librarian assistance. In the cross-tabular analyses, 
industrial scientists and -technologists, both users|j|d nonusers, 
generally tended to decrease their assessment of importance of practically 
all of these characteristics (Table 36). However, the correlational 
analysis for the industrial sample (Table 37) indicates a greater amount 
of decrease in ratings of importance for most of these traits by the 
control (nonuser) group. That is, the less frequent the use of online 
searching," the greater the degree of change t^ard assessed non-importance 
of information sources being up-to-date, accurate and authoritative, 
comprehensive and. complete, and either the citation,' abstract, or full 
document being promptly available. * ' 



.i 



' of laportance.ofl^characterlstics of 
Infonnatipn Sources: Users and Nonusers 
, of^Onlioe SI&rching, b.y Type/ 
' ' . ■ 'of Worl^ .Setting 

' '-1 r S' 



Characl;erlstics 



^'X; ^ . • Industrial Setting- ■ _ ' 

Direction of ffhange' "Slg. Test of.Mouit ' Direction of Change , Sig, Test of Amount 



Academic Setting 



in Importance 



of Chang e (p-valuej ^ In Iniportance 



of Change (p-yaliie) 



^Jsers Nflnusers Users'; Nonusers Users" Nonusers Users 



Loca;L Availability 
: , Up-to-dateness . 



' no changef less 



N.S. 



i less 



ijse time ' • 

■ • (citation/abstiact) • ' lels 

r Response, tile- . ' 

■ '(full document) ' less 

.> Accuracy/ • ' ■ . 
. . Aothoritat^veAtiss . less 

"'CoiDprehenslvefiess/ • 
' Completeness. less 

■ • ■ 

Direct Oseabllity', ' 
. Wo assistand? ■ less 



po change .01 

/ ' 

/ ■ 

less 



less 



less 



less 



le'ss 



.001 

r 

.001 



f 



.001 



kOOl 



.01 ' no: change no, change N.S. 
N.S. f it le^s ■ no change .02 



.02 



.001 



no 



ciajfi^ no change (J.S. 



no change' no change ,J.S. 



.,'.01 > . .OOl 



no change less : . ^ NiS. 
.001 ^ no change no cnange NiS.. 
.001 . 



Nonusers 



N.S. 
N.S. 

N.S/ 

N.S., 



no change /?ip Change U.S., . ; N.S; 



♦ 



ON 



Table. 37. - Relationship /of Amount of Online Use 
-and-Ching^-i-n-A8sessinent-oHipomnce"aftlra"racft^^^^^ 



of Information Sources, Controlling for Initial Assessment^' 
:' ; ', 'Of Importance, by Work Setting 



I. 



Industrial Settin|> 



Academlc,'Siettinf> 



Characteristics 



Partial Correlation fest^ of j Partial Correlation' i ' Test of - 

^"^"f Significance (controlling for pretest Significance 

level on change measure) (pTvalue) 



. _ level on change measure) , (p-value) 



Local Availability 
lip-to-datenes3 



•Response time ^ 
(citation/abstract) 'f 

I 

Response time 
(full document) 

Accuracy/Authorltat.ivencss 



Comprehensiveness/I 
Completeness 




.097 



.151 



.134 



v. 

n.S. s; 

.05 
.01 

iOl 



^;'^05 



.191 



.178 



.199 



.089 



.250 



.05 
.05 



•n..s. 

.» ■ 

.01 



Direct Useabllity 
w/o^ssistance 



^.Note: On the criterion and control variabjfs; the greater the' ' 
decree of assessed importance„the higher the score value. 
I ' Change equals post-test value minus pre-test value. 
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In cvContrMt toJi|ftie Industrial sample, the cross-tabular analyses 



. 



for the academic sapple produced few statistically g||niificant changes : 
^ w^en the user gro^ ^ridvthe nonusef group were' each anal^rzed separately; 
(Table 36). However, tfee sample size for eath subgroup is relatively 
' small ^^d jh^nce tj^e ciDxrelational analyses which combine both groups and 

prpylde mote : robust; starls^ics are more instruct ive.** The- results of 
^the c)i?rrelat ^g ial i^^^^f^es^ 37) fox tl^e. apademlcs largely parallel 

f^he TesyjLt^i^ij^ That is, 

la^^f^^^eqfe qnlln^sfen^ces were ^more likely to downgrade the 



ttfvolrX^iaixcelo.f ;|Lnfo 



llvet , and cc 



)rmat^ii^ 



^^m^f^es being up-to-date, accurate and authori- 




jpifehejy^ an^. compl^t^^ . The more frequent online users in 
"5^*^ -^^^^^ s*tt|a5y<^ more liKfemy to v^ue tl^e local aval Ability 

of -r«fN•fflffll^^>;kloTy:>^™..4p^-eg• and mprp lik»^ desired quicker response time 



f ot, o6[tainirfg; fit^ijfcs 4^^ abj 
rs^ent c 



-^an. did the less frequent users. 



2hin^ . 



Jfr' ■ ' ^ ' 
l^tiiig ewl? 



> ^ei^ed to :tlte..iM^ 6ill^fe ".bih4 



dia^gea oti- three .o.th^i: 
ar ttf<^jCfeaM 



patt^iii^arits 
t he .ade|(uacy 



Qth .the ^re- and pos t- 




\ 



tin-g^^l^Vfermation in setting. 



jS^oifaV^it^f'aTian and information speciaiist, and (3) 



^Syss'^the ig«n|[fc^''te^ of performi^tig oig^'s own information 

search. A^Mti* thel cross'-tabular results (Ta^le J8) are generally unclear: 



the statist:j^&aX «su^ a"te-based orl.-substantjtally large sample .size 



differences :>l|;^^tween users and nonu^ers and between the two^work settings. 
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■ ' Industrial Sett^n f ^ " 



ivrm — Tt;^ -rtr** » Academic Setting 

irectlon of Change^ I gMe^t of Mount Direction of Change ^ Sig. est of Mount 
■^JM^ j^Agree^enL^ ,^0^^ 



V.- ' .. 



rosers Nom^ Users.; Nonuser s Dsers 




■ Present means of 
■ locatli^ scientific 
infiifdatlon are 
adequate 

Librarian/information 
.. N^ecialist senes, ". 
^eful fui^tion * 

. Advantageous to 
^perform 'one's 
f own information , 
search-^ ^ ■ - 



/>■■■■ 

no change higher 



N.S, ,001 no change lower 



N.S. 



higher • higher .02. ^ .01 change no change. N.S. 



lower; lower 



:oi 



no change lower ^ U.S. 




f 



.03 



N.S. 



ON 
ON 



.05 



• A,(l'> 



Item 



Present meant of 
locating scientific 
information are • 

■ adequate 

LibrariaD/informatlon 
specialist serves 
useful -function 



||0U8 to • 

jp,i?rfonn one's « 
; own ittforiDation 
search • ' 



: Table 39 . Relationship of. Amount of. Online Use 
|nd Change in Level of Agreement with Selected .Items ' 
-oa-Inf«nDat-ion-Sear<:hin&r<3(^nfWHngrfor-lTritl^^^^^^^ 
of Agreement, by -Work Setting 



W~^' — 

' Industrial Setting 



Academic Setting 



Partial Correl^ion ' Level of' Partial Correlation Level' of 
cotitrolling for pretest Significance (controlling for pretest Signi'fiance 
level on change measure) (p-value) >| ;evel on change measure) (p-value) 




.171 



.01 



.05 



.188. 



.001- 



■ 1*«r.l01 



n.s. 



■■■ e 



.184 



nvs. 



r.Note: On. the criterion and conhq^va]||lM,fthe^^^^^^^ L 

degree of agreement the higher thf sSre va^.''' Cha^ 
^, equals post-test value minus pre-test valued * * ' 



% 



i ■ 



16^ 



Moreover, the self-selective *\iature of the experimental (user) and control 
(nonuser) groups resulted In Mke substantial differences between the 
tv^as regards the pretest responses on these Iteias. 

In contrast, the correlational analyses (Table 39) are Instructive. 



In* all cases, positive correlation coeffi'&lents ijere obtained. Indicating 

.."■In*' 

%hat frequent online users were more likely to dhange positively in their 
assessmenj^ of the value of all these measured aspects. The more f requent (f^JSjs 

online users, 'in both work settings, were significantly more likely to be 

V ... 

more satisfied with the adequacy of means of locating information after . 

ihtroduq|lon and use of the online searching capHilities. In the industrial 
<rS«tt^, statistically significant positive changes were ^hibited with 
J regard to' ithe frequent online users' assessments of the services of 

/ 



librarians and information specialists; a parallA relationship emerged. . ^; 
for the.acadqpic chemists, but did nqt reach statistical significance. 
Similarly, for both the |indus trial and the academic groups, small positiye, 

/but not statistically .significant, results are -shown between frequency 
of onli||.^ use and agreement that it is Myajitageous to perform one's 
own information search. ^ ^-':^r^^ 

Summary and Conclusion 



' J- The foregoing analyses focus oti the impact of use of online bibli'o- 
graphic searching on subsequent information style and in|prmation pre7 
ferencea inVwo distinct^ environments. methodol^I^jPca^ approach is 

*bajfically that df a quasi-experimental design, with pre- an^ post- 

^ assessment, supplemented by c^)ri:elaticamal analysis|g:o adjust f 



differences in the self-selection |o/ the experimental (users ""of b 
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^ services) and the control (nonusers) groups • in this summary, we focus 
on those- findings which are statistically .j;^.g3||f leant, based on the 

correlational ^analyses, and which are mirrored across both settings 

■ ■ ■■ . 

(Industrial and academic) . In the cases where the findings are) duplicated 

'•o • . - . • . 

across organizational settings, we presume relatively bro§id generdlizabllity 
0' of results. 

Across both settings, . there was generally no consistent efffect of 

tlme^pent In other Information dissemination and 

• . •. • • -- • ' . • 

gathering ►adtlvltles.. tor both Industrial and academic users, however, 

^ ^ there was significantly greater reliance on librarians than formerly. 



Apparently, online searching uncovered more literature r^ilicences than 
dlidi the meanei employed prior to tHe introduction of online searching, ,and 
, likely th^e additional bibliographic references were not generally 

directly accest^ible ta the users without librarian assistance. Consequently, 
organJzati(^dfcwhi^h plan to ac^opt qnline bibliographic searching 

^r ..^^^^ plan to enhance librarian 

fi;^— Information specialists assistance. . . ^ % 

'V'>'.*- - , ■ ^} ■ .^^.-^^ ^ * /. '^^^fi^-^iA 

^ . As compared to nonuserng^ and infrequent users, frequent iisers In -iSTV ; 

both ^et.tings also increiased their assessment of .the utility of citations 

■ ^- i"- ■ ' - .■ - > . • ^ • 

' from othet wotlcs and the grcannlng of primary sources as Important sources 

of lajtormjatioh. Not'"stirpr;E^lng,ivthe most fre'quent users- of oril'lne search 
". • \ -■■ ' .* / ■ ' ■ . . ^ ' ■ • 

seiv^iqes -ialso 1^ appraisal of -the utility of online ^ 



systenM to l:heStoj[^ork* Clearly, a substantlal;,^gree of etithusiasm for 



: ; online Searching wasf ge both setlMgS through the introduction * 

- of the oppoi^ppalty to use t;^|^^ services. ' , ^ -^'^^r- * v 

Iniirefsed their appraisal of the adequacy 
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of information servlc 



es available to them. 'They...al4pL-ihcreased thel^ 
value on tislng InfojGtnatlon searching tools "K^'^i^' 




quick turnaround In reporting citations or 
^authoritatLiye , and that are relatively comprehensive and complete. 



All of 



these tritits'^re- 6^^ as prfmary^ benefits of fered by 



online bibliographic seaircHihg; In conclusion, glveft the high value now 

■:. ■ /:r^,- . •. . - ' • f 

.■ .. ' ■ . , . ; - . . - . --/N 

placed on some of the primary atttlbutes of online bibliographic searching, 

' m 

and the overall change In Increased enthusiasm for online services by 
users ovl|^the study p§jirlod, it is not surprising that upon completion of 
this study project both organizations have elected to Install online 
search capability as a' permanent feature in the work setting" ' ' * 

. Tlie results from this study are by no means definitive, however. 
First, there is need for further longitudinal study of the effects? of 
online sj^rching and other recent technological innovatlpiis for 
literature searching whibh is bas^y^^n tjue experimental designs. That 
is. Studies based on random assignments i|flH|B2||^ tO' treatment 




and non-^tre^atment groups, or' the assignment matched pairs* to respective 

different treatments; is recommended for future research. ' 

'Finally, our attention in this section of the report has been on 

. • - 1, 

attempting to assess the impajtt of the availability and use of online" ^ 

« » ■ . ■ • 

search services on scientisfts' subsequCTt information styles and attitudes.' 

largely introduced In order tp enhance the work «f scientists and'^the 
advancement of science. /Therefore, futu^ research- "^hjbiild^^^ on 



Ultlfatftely, hov^ever, new tools fJr scientific information searchi^'Sre 



related ^otig^^ range criteria — measures or**s^cdLentlS^ «p^pj^bqtivii:y and the 



impact' of the .sdientific enterprise, , as it/m^^|!^p!|ten^e3«j:)y;,new 
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^ .-^^^ i ^ dissemination tools, on the development and progress 



In science ^d kno||ledge/ 



..... Jj. 
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-SUMMARTTiaro- CONCLUSIONS'^fe^ 




Online searches were conducted In an academic setting, the Chemistry . 
Department Of the iflorlda State University, and In an Industrial settlhg, 
the Monsanto Textile Company. The study was conducted In ;three phases. v.. 
In Phase I, conducted ±n both thfe academic and Industrial settings /fre^^ 
to the users, mediated (searched by information speclal^J^ 

provided. Records of 353' searches conducted for 50 academic users^i^™^"^*^ 
an eleven month period are analyzed. Records of 345 sea^chWsi^to^ 
for 109 industrial users over a period of 13 mpnths are 
to the start of online search service, scientists and technolo^ 
asked to complete a questionnaire dealil^ mostly with^ questions 
their information style. A similar questionnaire was distributed to the 
Scientists and technologists in both settings after the completion of ..J 
Phase I. A number of users and non-users, of online search service wieje " 
al^ftr&ierviewed prior jtp the start of Phase II. In Phase II of the study, 
, only in the acadefflfc environment, 155 searches for 57 users were 

colle^^d during a seven and a half mgnth periodT. The Phase II searches *' 
were c<m^UQted by Information specialists and the users were- charged half 
-;^^t^^ <^ offline prlntingj^cKarg^s^ — In^lt^ IIlf||^ 

also conducted, only In the academic setting, records' of 87 "searctTe^ J foi^ ' 
44 users were co;Llected during a one and one-half njonth perlgd , Phas6>III 
searches were conducted by the final- users' of the Infbriatlon (non-mediated 
^searches) and we freef tjj^^he us|rs. ^Selected results will now be siim- ' 
. marlzed. . •• • ^ ■ ; : ■ ' 

Prediction of Users of Onli ne Search Service ■ ' ' (- 

y . . Despite a broad array of data on personal, ajid prdfe background, 

establlsRea ittformatlon styles and appralgal .^^^^^^^^ aciequacy of Information'' re- A 
gources, a^'d nieasures 'of prior, attlt^udes and experlehce 'with online sWch " 









^^^^^ 
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•collec^rtms, and dljs cuss ion with colleagues prior to requesting an online 

search Sand less negotiation time per search. -Searches by heaVy-i^dus trial 

users (10 or more searches per user) did not have these differentiating 

characteristics. ' 

Calendar Age of Users k 

\ ' • > * ' ' ■ 

IiK^he analysis by calendar age of users, younger academic .users (27. 

years or younger) had ^fewer requests in written form, fewer author con- 

straints, fever exhaustive and current awareness searches, and fewer 

searches of data bases other than CHEMCON. The number of searches for 

younger industrial users was too small for statistical analysis. 

Professional Age of Users • . 

[ . . . '■ 7 . ' - 

In the analysis by professional age (the number of years since the 
highest degree w;as received) the younger academic professional users (6 
or fewer jrears $ince highest degree was received) submitted few^r re- 
quests in writing, had. the fewest requests for current awareness searches, 
and searches fc^r facts, and the highest number-of uses for a few references 
on a topic and;for procedures, methodology, and apparatus.^ Younger aca- 
demtc users made .more searches of thfe printed 'indexes prior to requesting • 
online searches, required the highest amount 'of negotiation time," and were 
more satisfied with the currency and utility of search results. Profes- 
sionally x^unger indus^frial users planned to look up a larger number, of 
potentially relevant citations rleved than other age groups of indus- 
trial U^HTS. • ■ ' ■ " 

Position of Users ; 

In the analysis of user by pd»4^tlon of academic users, fewer student 
requests were submitted in writing, more of the student uses entailed user 
interaction dufing searches, student uses required more negotiation time, 
and fewer student uses were preceded by searches of personal docOment 



services, the analysis of correlates of yho would and who Vould not use 
online services yielded relatively low predictive power. Moreover , there 
was little similarity, or repllcablllty , between the correl^es in one 
setting (industrial or'^atademic) and the cor^r^^t^s in the other setting. 
In neither netting, based on a multiple regression model, could as much ,as 
25 percent ot the variance (R ) be explained in subsequenit use or nonuse 
of the online bibliographic search service. Hence these results tend to 



confirm the earlier findings of both Curtis and Stem et al regarding 

i 

readable bibliographic data bases, eith online or batch. * 



generally negligible differences between users' and nonusers of computer- 



Nevertheless , in broad terms, these results do suggest that prior 
informatio^ "style," satisfaction with more traditional information re- 
sources, and attitudinal predisposition to the possible utility of on- 
line search^6ryices , have some small effect on subsequent usage of on- 
line services.' 

Effect of Online ^yistem Use on Users^ Information Style^ 

The methodological approach is basically that of a quasi-experimental 
design with pje- and post-assessment supplemeixted by correlational analy- 
sis to adjust for differences lA^he s^elf -selection to. the experimental 
(users of yonline servipes) and the control (non-users) groups. Findings 
based on correlational analysis that are statistically significant for 
the academic and industrial settings are sumyjarized • Across both set^ 
tings, there was generally no consistent effect of online searching on 
tinte spent in other information-disseminating and gathering activities. 
For both industrial and academic users, however, there was significaht- 
/ly greater reliance on librarians than formerly. As compared t/)» non- 
users and infrequent users of online search services, frequent]! users in 
both settings increased their assessment of the utility of citati^s from 



Other works and the scannlnjg of primary sources as important sources 
of Information, not surprising/ the most frequent users of online search 
services also most Increased their favorable appraisal of the utility ot 
online search services to their work. In both settings, online search « 
service users Increased their favorable appraisal of the adequacy of in- 
formation services available to them/ They also Increased their value 
of using information searching tools that are up-to-date, provide quick 
turn around time in reporting citations or abstracts, are accurate and 

w . . ■ i 

authoritative, and are relatively compfehelttive and complete. 

Phase I Results ' 'S. 

t. 

In comparing academic with industrial users, ^It was found that, among 
other things, academic users had more auti^or and time constraints There 
were more exhaustive 'Searches and more searches' for^ a tew references on a , 
topic, but fewer searches 'for specific facts or procedures by academic » 
users. More academic than industrial uset^ were present and Interacted 
during searches. ^ • • -i^ 

Time of Use , ' , . ^ ^ i 

Later academic uses* (uses iiade after three months of search service)- 



consisted of a larger ^number of delegated searche^^mbre searches with 
constraints and a time period to search and greater utilization of search 
results for other than research purpose^. Later industrial uses ddi^not 
resemble later academic searches In these ways. In cpmparlson with tlie 
ea^y industrial uses, later Indust^^l^l uses wex^pxec^ded by f eWer man- t )■ 

■I ■ ' ■ ■■ ' r^- < 

lial searches. ' ^ 

i^* . -■• 

Frequency of Use * . , '. iL ^ 



In the analysis by frequency of use, searches Uy heavy academic ^(10 
or more searches per^user) users had mote time constraints, more uses for ^ 
other tHan research, fewer seairches of ma^iuai Indexes, persoffal document r 



collections or discussions wlfh coUeagues. In thf Industrial setting. • ' 
supervisors were »6re lltely t^ call m requests by phone than .non-snper- " 
- . visors, less likely to use the system, f^^ either currfent awareness or . '. 

pro^dures. methods, and i^thodolo|y. and more likely to use the older 
literature. ' 

Phase II Results ; • 

Phase II uses (half cost, mediated) In comparison with Phasp 1 uses ' V 
(free, mediated) had more search requests submitted with synonyms and 
search logic, more date cons^alnts. greater use for current awarWss 
and for learning abo^Jt a- new specialty, for theory, and for sV^clflc facts. • 
Phase II use^ als^-'entjl^ed more negotiation time/less connect time and 
: fewer o^f^rine citations. Phase II users were less satisfied with the 
^e-but more satisfied with both the, currency and the utility oi the 
^output of Phase^II than Phase 1 search results. 



1 

Phase^Mf Resu lts 

i 



comiJarlson with Phase 1 os^^ (free, mediated). Phase III uses^ . 
(freej Un-me^lated) were^onducted more extensl;>rely for current aware- ' 
^s/Hor bpishlng up on a subject, for learning a new spedlal^y. and 
for-pheory.j^^. and^racedures / Gr\^ter use was made of mknual In-, 
dexes. Incluilng pe^sonal^document collections, and discussion with col* 
leag{,esV*or to conducting Phase III Searches. Phase III searches used 
more search statements and computer connect time and were judged less 
satisfactory in terms of size but nore satisfactory" m terms of utility 
of search output than Phase I search results. Two other findings that 
could be observed from the us^ records and that held for both acadenilc^ 
,and industrial settings and, fot all^B?^^ ph^ies ^^^^ the study ar 4 also 
highlighted in this section. They "are. the percentage _^of searche§t..that ' 
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were delayed because of technical problems' and the percen^tage of .searches 
that, according to the usej, had relevant but ribt retrieved document ci- 
tations. In Phase I, conducted in 1976 and 1977, 24% of the academic 



j searches and l7% of the Indus t^fial .searches were delayed because of tech-r 

nical problems while the, figure *for Phase^III, searches , conducted in 1978, 

: . • ■' ' ' .i: -^ ■ 

was 16%; Delays were caused by telephone, . telecommuhication, and computer 

■ ■ • . — ■ ^ • • . n 

'problems. . 

In both settings and all three phases of^ the study a high percentage 
of the search results failed to ^includfe relevant documents kiibwn to the" 
users.. Based, on the analysis of user feedback forms, 42% of the Phase I' 
academic uses, 57% of the Phase I industrial searches, 41% of the Phase II 
searched, and 52% of the Phase III searches failed to retrieve known rele- 
^ vant oocument^. ^ , « , 

^ Despite these problems, .user satisfaction -with search results was 

high. Size of search output was about right in approximately two-thirds 
of f the Ph^se I and II searches and in over half of the Phase III searches. 



Eighty-four to ninety-two percent of all the searches were considered very 
satisfactory or satisfactory in terms pf currency of search output and 
seventy-si'X to seventy-eight percent of all the searches j^re considered 
very satisfactory, or satisfactory in terms of utility of aearch output. 

Online search service was taken over hy the Company library in the. 
industrial setting and is now one of the information services offered to 
Company employees. The Chemistry D^pdrtment voted to take over (and pay 
for) the online service in the academic setting. At the time of this writ- 
ing' (March 1979) the Chemistry Departmen^is providing online services on 
a self-search basis, with a charge to users to recover some costs. ^ 



Summary of Data from' Information Specialist 's' Record 



of .;Onllne Use 



Item / . ^ 

Search request received 
In writing/ 
In person 
By phone 

By other than^ final user 

Relation to prior searches 
^ew search 
^/ Continuation 
Modification 

User assistance 

Synonyms supplied 
Logic supplied 

Search constraints - 
EngjLish only 
Author 

'Publication type 
^ Maximuih^ number / 
Time period 
Otbeir 

Purposfg of search 
Teaching 
Research 

Other, course related 
Other, no^t course related 

Type Sf search 

Current awareness 
Exhaujstive 

A few references, browsing 
Specific facts, procedures 

Purpose of use 

Stay current, own area 
Stay current , relat^ed area 
Brushing up 
Learn new specialty. 
Support ongoing work-theory 
Support ongoing work-facts 
Support ongoing work- 
procedures . 



Free Mediated, Phase I 
Industrial Academic 
N=J45 li^es N=353 uses 



23.2% 
67.8 
15.9 * 
2.3 



60.6% 
91.2 ' 

0.0 ; 

7.9 



Half,-Cost 
Mediated 
Phase II * 



Free 



41.7% 
80.1 
0.6 
14.1 



72.4 


69 .7 


70.5 


16.3 


■ 11:6 


; 19.2 


111 


ICO 


5.1 


56.8 


4-3.3 


57.7 


16.8 


22.4 


,31.4 


2,3 


0.8 * 




6.7 


19.8 


9.6 




U . U 


0.0 


2.6 


1.7 


0.6 


1.2 


^1.3 


20.5' 


1.2 


■ ^ 5.7- 


5.1 


0.0 


2.0 


2.6 


100.0 


. 85.0 


■ 85.. 3 


0.0 


2.8 


2.6 


0.0' 


8.5 


3.8 


9.0 


12.7 


26.9 


33.3 


49.6 


42.9 


13.6 


22.1 


14.7 


39.1 


- 13.9 


: 14.7 




w 




40.6 • 


52.7 


58.3 


10.4 


16.7 


18.6 


8.4 


• 8.8 . 


12.2 


18.6 


19.8 


36.5 


12.5 . 


18.7 


43.6 


25.1 


36.3 


59.0 


53.0 


.24.6 


44.9 



Non-Mediated 
Phase III 



N=155 uses N=87 uses 



17.2 
100.0 
0.0 
6.9 



74.7 
11.5 
11.5 



43;. 4 
40.2 



. 4.6 
19.5 
0.0 
0.0 
4.6- 



85.1 



28.7 
,50.6 
21.8 
12.6 



.1, 
24.1 
19.5 
43.7 
36.8 
56.3 

41.4 



1 o T 



180) 



Informat ion Spe cialist'^ Re cord (contQ 



Item 



Free Mediated > Phase I 
Industrial Academic 



Half-Cost 
Mediated 
Phase II 



Free 

NonHMedlated' 
Phase IIL 



Preparation for " * 
Internal meeting 
Internal report 
Potential afipllcation 
Publication 
Dissertation 
Grant prop09al 
Testing system 
Other 

Sources used prior to ojUlne searc'h 

Manual Xearch of Indexes 
' Onllpe system aids : ^ 

Personal collection 
^>^scuss with colleague ' • 

Internal^company report 



Search negotiation time 
- None V 
,1-2 V . 

<^ -2-3 

Fllgs used ' ^ ' ) 
CHEMCON 

CHEM7071 ' ' . 
COMPENDEX- 
-AGRICOLA ^ 
BIOSIS 
GDI 

GRANJS ^ ^ , , • 
NTIS ' *' 
POLLUTION ^ 

ssiE . ' ' 

Search statements used 
M-3 ■ ~ 
4-7. 

'■. 13+ 



(mln . )" 



2.6 
4.6 
1.7 
5.2 
0.6 
0.0 
0.9 
8.1 



22.6 
3.5 
40.6 
38.3 
9.6' 



NR 
NR 
NR 
NR 



83.5 
28.7 
10.1 
0.0 
0.0 
-0.0 
0.0 
4.3 
1.4 
1.2- 



12.5 
29.0 
24.6 
31.6 



4.fe 

;::0.8 
"i 0.0 

32.6 

20.1 
5.7 
0.3 

12.7 



27.8 
0.8 
34.8 
22.7 



28.0 
26.6 
24.4 
21.0 



•7.1 
4.5 
0.0 
37.2 
19.2 
5.1 
0.0 
5.8 



36.5 
0.6 
42.9 
27.6 



28.8 
31.4 
17.3 
21.8 



6.9 
5.7 
0.0 
20.7 
10.3 
1.1 
0.0 
11.5 



42.5 
18.4 
47.1 
43.7 



11.5 


25.0 




28.9 


\ 8.3 




25.5- 


26.3 




33.7 


40.4 




94 .-6 


f . 

98.1 


95.4 


24.9 


17.9 


23.0 


0.3 


0,6 


0.0 


0.3 


0.0 


0,0 


1.1 


9.6 


16.1 


0.3 


O.'O 


1.1 


0.8 


0.0 


0.0 


0.3 


0.0 


0.0 


0.6 


1.9 


0.0 


3.4 


0.0 


1.1 



14.9 
28 .'7 
24.1 
31.0 



ERIC 
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— Inf^nim t ion - Specla4±s r • s- Recd*3 -(c^^^ 



1 



Item 



Free Mediated , .Phase I 
Industrial Academic 



llf-Cost 
Mediated 
Phas^ II 



Free 

Non-Mediated 
Phase III 



36.8 
37.1 
20.0 
6.1 
63.2 



20.9 
28.. 4 
29.6 
19.7 



0.3 
0.6 



Citations printed 
Online - 

7 0-3'- ■ ■ • ' 

4-10 , ' ^ 

11-20 . 
21+ 
Offline 

• Terminal connect time (mln.) 

~r^7 '■ 

8-13 
14-23 
24+-. - 

Post-sea rch staff "time with -user (mln. ) 

^^-2 ■ ~ 

- . 2+ ■ 

User present for search 

In. person 44 6 

By phone 2.7 

' User interaction durinf^ search 43.2. 

Search delay due to technical problems 17.4 

Delay duetto ; 
\J.og-on * 
Tymshare 

Disconnect m 
. Terminal malfunction 
Host down 

Data base not available 
Telephone problems 
• ' Other ^ 

Number of citations retrieve d 

0^ '. " 
' 9-23 - . 

., 24-65 

66+ 



1.7 
6.4 
2.9 
0.0 
1.7 
0.6 
4.3 
0.9 



\ ■ 

26.1 
23.8 
24.9 
25.2 
36.3 



22.1 
28.3 
24.6 
24.9 



25.5 
13.0 



70.0 
0.0 

71.1 . 

23.8 



10.8 
'9.6 
4.2' 
0.8 
2.5 
0.3 
2.0 
2.5 



34.6 
23.1 
17.9 
24.4 
26.9 



39.1 
'28.2 
17.9 
14.1 



10.9 
17.3 



66.7 
1.3 

65.4 

24.4 



14.9 

28.7 

26.4 

29.9 

41.4 
1 



11.5 
19.5 
24.1 
44.8 



2.-3 

100.0 
0.0 

100. 0 

16.1 



22.3 
27.8 
25.2 
24*6 



24.4 
25.5 
31,. 4 
18.7 



7.. 7 


2.3 


"0.6 


0.0 


8.3 ' 


8.0 


0.0 


0.0 


7.1 . 


3.4 


0.6 


0.0 


2.6 


1.1 


2.6 . 


3.4 


35.9 


: 7 ' 

18.4 


25.6 


25.3 


17.3 


23.0 


21.2 


33.3 



ERIC 



109 



7" 



182 



Summary ot Data from User 's* Reaction Form 



Item 



* . Half-Cost 
Free Mediated, Phase I Mediated 
Industrial * Academic •'Phase II 



Free 

Non-Mediated 
Phase' III 



Citations familiar prior to search 
0 

1-2 - - V ^ 

3-6 ; 

7+ . . 

New citations ' 
0-2 

3-8; 'V ■ 

9-18 X 
19+ ' 

Known citations not retrieved 



;at6 further 



Citations to Investj 
0-2 
3-5 
'6-12 
13+ 



Opinion on number retrieved 
About right 
Too ,niany ' ' 
Not enough 

Opinion on curre'ncy 
Very satisfactory^ 
~~ Satisfactory ' 
Unsatisfactory 
Highly unsatisfactory 

Opinion on utility of results 
. Very satisfactory 
Satisfactory 
JtpSatisfactory 

ly unsatisfactory. 




41.4 
12.2 
14.8 
31.6 



■28, 
21, 
18, 
31, 



56.5 



34.2 
18.^ 
16.8 
^0.1. 



64.3 
5.5 
19.4 



34.8 
49.3' 
3.2 
1.7 



'50.4 
24.9 
9.6 
5.5 




'30.6 
^9.5 
19.5 
30.3 



26.9 
24.4 
19.8 
28.9 

41.9 



28.6 
21.8 

21 .*b 

28.6 



68.3 
7.1 
13.0 



43.9 
43.1' 
1.1 
0.3 



53.8 
24.1 



41.0 
19.2 

24.4 



35.9 
25.0 
14.7 
24.4 

-41.0 



36.5 
20.5 
14.1 

D 28 • 8' 



68.6 
7.7 
19.9 



44.9 
46.8 
i.9- 
1.3 ' 



.53.2 
33.3 
. 5.'8 
7.1 



NR 
18.. 4 
1^.2. 

3r.o 



27.6 

.23^.0 
17.2 
32.2 

48.3 



32.2 
25.3 
10.3 
32.2 



56.3 
8.0 
31.0 



33.3 
52.9 
5.7 
• 0.0 



54.0 
)33.3. 

■io.3 

1.1 



0 

ERIC 
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RESPONSES TO PRE- A,ND POST-TREATMENT QUESTIONNAIRES 



Response Category 

(Not alL questions 
were asked on. both 
pre- and post-tests) 

Sex ^ ' ■ ■ -^^ 

Male ^ ' - . \^ 
Female 

NR . \ \ \ 

Highest "^Degree » 

Less than col. 
, Bachelors 
. Masters 

Doct. w/o Dis. 

Ph.D./ 

Other doct. 

Other 

nr: ? ■ > 

Field of highest'degree 

' Organic chem. 
Inorganic chem. 
Biochemistry 
Chem. engineering 
Physical chemistry 
Chem. /other chem. 
Medi. engineering 
Other engineering 
,Physics 

Other phys. sci. 
Business /admin. 
All other 
NR. 

Year of highest degree 
1901-1940 ' ^ 

1941-50 
1951-60 
1961-65 

I965-'70 I 
1971+ 

Yjear since continuous 
service at MTC/FSU 

1901-40. 



Industrial^ Sample Academic Sample 



1941-50 
1951-60 
1961-65 
1965-70 
1971+ 



Pre- test 
N = 262 



255 
5 
2 



Post-tesjt 
N = 233 



NA 
fi 



Pre-test 

NT = 70 > 



61 
9. 



21 
7 
2 

39 
1 



8 

3 
7 

5 

44: 



1 
1 



Post-test 
N - 50 



NA 
II 



II 
II 
II 
II 
II 

H 



II 
■ M 
II 
II 
II 



II 
It 



NA, 
II i 

fi 

II 



If 
II 
II 



ERIC 



r 



20 1 
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^Response Category 



Industrial Sample Academic Sample 



Pre-test^ Post-test 
N > 262 



Pre-test 



Post-test 



=■ 233 


• N 


= 70 


N ='., 




Present position 








Full Prof. 


15 


10 




Assoc. Prof. 


6 


■5 


NA 


.Asst. Prof. 
Postdoc. 


4 . 


3 




Fellow 


4 


1 


II 


Doct. Cand./ 


2i 




Student 


12 




Res. Assoc. 


12 


8 


II 


Other 


3 


1 



Pri^sent job designation 
* 'Supervisory technician * 
(Foreman , Lab . Super- 
visor) 

^Supervisory C/E Group * 
Leader (Supervisor 
Nylon Development) 45 
Supervisory C/E Senior 
Group Leader, Senior 
Research Group Leader 15 
Supervisory C/E Manager 

(Resear.ch.'^Manager) 8 
Non-supervisory techni- 
. cian' (researdi techni- 
cian, Senior engineer- 
ing, Prcxc^ss-lng tech- 
n^ian) : ■ 

Non-supervisory "C/E ^ 
(Bench ch*em. engineer, 
A,*B; Engineer I, II; 
Chemis t II) , ^ 28 

Non-supervisory C/E 

Senior (senior., mechani- 
cal engineer, polymer 
physicist, senior re- 
search chemist) 83 
Ifon-supervisory spe- 

cialist 51 
Non-sCipervisory senior 

specialist 22 
Non~supervisory scientist/ J 
science or engineering * 
fellow 8 



Time spent on Administration , 



None 


60 


34 


42 


31 


1-4 hrs. 


81 


87 


15 


11' 


5t8 hrs. \ ^ 


41 


39 ' 


5 


, 5 


9-12 hrs. A 


r 25 • 


23 


3 


1' 


13-16 hrs. ) 


' 12 


16 






17-20 hrs.^ . ^ ''^ 


12 . . 


10 






21-24 hrs. 


, 3 


4 


1 ; 




25-28 hrs. A 


3 . 


3 






29^32 hrs. 




4 ' 






33 + hrs. 


1 








NR . ' • 


24 


13 


3 


• ' 2 



ERIC 
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1-4 hrs. J 0 89 74 

5-8 hrs. y 74 ' 61 

9-12 hrs. 2S 30 

13-16 hrs. • .7 10 

17-20 hrs. : 3 4 

21-24 hrs. 1 1 

25-2*8 hrs. 1 
29-32 hrs. 
.33 + hrs. 

NR 29 16 

Professional Papers 



If 



Response Catej^o ry ^ Industrial Sample Agademlc Sample 

Pre-testfc Post-test Pre-test Post-test 

•• " ^'Z ' ■■■.11 - 262^ ,N = 233" N = 70 N = 50 

Work In Labojatorjj • ^ 

None / ■ '61 * 52 NA NA 

1-A hrs. 0 35 Al " 

. 5-8 hrs. . . 25' . 22 " 

9-12 hrs. ^ 28 ^ 30 " 

13-16 hrs. ' • ^ 25 ' 18 . 

0-'2O hrs. lA • ' 16 

21- 2A hrs. ■ 20 13 " . 

25-28 ih'rs. 9 -6" , " 

2g!r3^2'hrs. 8 .10 

33 + hrs. 8 - 6 " " 

m 29 19 

Research Reports • , . ^ . 

None \ -30 37 ' " 



None 


125 


119 


fl 


tl 


1-A hirs . - 


"56 . 


* 56^ • 






5-8 hrs. 






II 


II 


9-12 hrs. 






!!_ 


If 


13-16 hrs. 


■ ic 




ri 


'if 


17-20 hrs. 








ff 


21-2A hrs. 






ti 


ir«. 


25-28 hrs. 






tl 


II 


29-32 hrs. 






fl 


11 


33 + hrs. 






II 


fl * 


NR 


62' 


39 






Locating I^i^^tmatiOn 






V 




None ^ f ji . . 


3 


A 


1 




1-A hrs. f: Ji.-'j? 
5-8 hrs. 


-.135 


126 


A3 


.3A 


69^ 


68 


19 


11 


9-12 hrs. 


30 


22 


A 


3 


13-16 hrs. 


7 


6 






17-20 hrs. 










21-2A hrs. 










25-28 hrs. 


,1 








29-32 hrs. 




7 






33 + hrs,: ^ 
NR * 




3 


2 



r 



186 



Response Category 



Reading Professional 
literature , 

None - . 

1-4 hts. \ 

5-8 hrs. 

9-12 hrs,^^ 

13-l«(^hrsr 

17-20 hrs. 

21-24 hrs. 
► 25-28 hrs. 
•29-32 hrs. 

33 + hrs. 

NR , . 



Dept. /Project 
meetings 

None 
' 1-4 hrs. 
^5-4 hrs. 

9-12 hrs. 

13-16 hrs. 

17-20 .hrs, 

21-24 hrs. 

25-28 hrs. 

29-32 hrs. 
' 33 + hrs. 

NR 



Industrial Sample 
P re- te^t Pos t- tes t 
N - 262' N « 233 



Academic Sample 
Pre-test Post- test 



N - 70 



N = 50 



Lab research/Aiialysls 

None •' 

1-A hrs. 

5-8 hrs. 

9-12 hrs. 

13-16 hrs. 

17-20 hrs. 

21-2A hrs. 

25-^28 hrs. 

29-p2 hrs. 

33 + hrs. 
. NR 



Writing 
None 
l-A hrs. 
5-8 hrs. 
9-12 hrs. 
13-16 hrs. 
NR 

Meetings 
None 
1-4 hrs. 
5-8 hrs. 
NR 



1 






, - 


119 


116 


27 


20 




fin 


lo 


13 


30 


25 . 


17 ■ 


10 


11 


8 


5 


4 


2 


1 


1 


1 


— 


1 , 


— 




— 


T- 


1 ' 


1 


> 1 


— 


— 


— 


— 
9 




2 


— •■ 
1 


— 
1 












4 t 






VI 


9 


NA 


NA 


146 


121 ■ 


11 


II 


61.. 


58 • 


II i 


11 


19 


'* 28 




II 


'3- 


6 


II 


if 


^ 3 


3 


II 


II 


— 


-i~ 


II 


fl ' 


1 


1 


II 


II 


— 


— 


II 


If 


— 


1 — 


II 




17 


7 


II 


II 

. 




NA 


4 


2 


If 


11 




• 4 


If 


II 


\ - r 




f f 


fl 


6 




f 1 


II 


3 


/ 3 


II 


II 


7 


/ 5 


II 


II \ 


i J 


' 4 


II 


11 


5 ^ 


5 


II 


11 


^ / 


2 


fl 




20 I 


13 


II 


tl 


4 


3 


II 




11 


9 


ft 


II 


29 


20 


II 


II 


14 . 


9' 


II 


II 


7 


5 


II 


II 


5 


4 


II 


II 


4 


3 






23 


18 


If 


II 


40 , 


27 


II 


II 


4 


3 






3 


2 




2^: 







Response Category 



\ 



Informal Discussions 



187 



Industrial . Sample Academic Sample 
Pre^test. Post-test Pre-test Post-test. 
N = 262 N = 233 N = 70 N = 50 



f None J ' 


3 


2 




— 


1-4 hrs 


98 


87 


34 


25 


^-8 hrs. 


102 


90 


27 


20 


9-12 'hrs. 


36 


34 


, ■ • 5 


1 


* 13-16 h^s. 


7 


14 


_— 




17-20 hrs*. 


4 


2 


1 


. 1 


21-24 hrs. 


1 


— — 


— _ 


— ... 


25-28 hrs. 


1 


1 






NR 


\ 10 


3 


3 


< 3 


Teaching 


J 






*' 


None 


NA 


NA 


35 


.22 


1-4 hrs. 


II 


II > 


2 


2 


5-8 hrs. 


II 


If 


4 


3 


• 9-12 .hrs^ 


II 


II 


10 


7 


13-16 hrs. 


II 


II 


8 


6 


1 17-20 hrs. 


II 


f II 


5 


4 


21-24 hrs , 


II 


If 


2 


2 


25-28 hrs. 


' II 


II 


1 


1 


NR 


II 


II 


1 3 

• 


3^ 


Advising Students 










None 


II 


II 


38 


26 


1-4 hrs. 


II 


II 


11 


7 


5-8 hrs.^ 


i II 


II 


12 


12 


9-12 hrs. 




II 




2 


13-16 hrs. 


1 II 


II 






17-20 hrs. 


»fl II 


II 


6 




NR 


■ i " 


II 


3 


3 


Attend Class 


• • 








None 


, II 


II 


41 


25 


1-4 hrs. 


•1 


II * 


• 9 


7 


5-8 hrs. 


11 


ti 


4 


3 


9-12 hrs. 


It 


II 


•3 


3 


13-16 hrs. 


. ti 


11 


1 


1 


NR 


ft 


II 


12 


11 


Other 


- 








None 


13 


12 


■ 6 


4 


1-4 hrs. 


7 


2 


2 


2 


5-8 hrs.. 


14 


10 


2 


1 


9-L2 hrs. ' 


16* 


9 






13-16 hrs. 


8^ 


7 






17-20 hrs. 


8 


6 


1 


.1 


21-24 hrs. 


2 


1 


% 1 


1 


25-28 hrs. 


8 


2 




29-32 hrs. 


3 


^ 5 




V- 


33 + hrs. 


5 




2 


/l 


NR 


178 


. 179 


56 


40 



/ 

• / 



2 OS 



188 



■if:- 

Response Category 





Numhpr of job titles 
In Iprevlous 5 years 
One 
'Two 
Three 
Four 
Rivet 
Six 
even 
^ght 
le ^ 

NR . . 

Types of work since 
highest degree 

College teaching - yes 
Otherwise , v 
College Riesearch - yes 
Otherwise 

College Teaching/Research 

Otherwise 

R&D Business 

Otherwise 

R&D government 

Otherwise 

Exe cu t i ve / Adminis t r a t or 
Otherwise 

Other Professional 
Otherwise 
Student 
Otherwise 
Other work 
therwise 
Primary former work * 
Secondary 
College Teaching 
College Research 
College Teaching/Research 
R&D in Business. 
R&D in Government 
Executive 

Other Professional 
Student 

Other ^ 
NR ^ 

\ 



4 



Indus trjLal Sample 
Pre-test Post^Eest 
N » 262 N = 233 



A4 
43 
41 
32 

25. 
/5 
4 

i6 



10 
252 

11 
251 
16 
246 
191 

71- 

14 
248 

28 
234 

44 
218 

23 
239 

24 
238 

2 

9 
13 
11 
58 

5 

5 
24 
102 
19 
14 



.NA 



II 
II 
II 
II 
II 
II 



II 
II 
II 
II 
II 
II 
If 
II 
It 



J 



Academic Sample 
Pre-test Post-test 
• N = 70 N = 50 



NA 



II 
II 



10 
60 
27 
43 
30 
40 

5 
65 

5 
65 



70 
3 
67 
28 
42 
6 
64 



4"- 
12 
14 

2 

2 

1 

1 

. 28 

3 
3 



7 



NA 

II 
II 
II 
II 
II 
II 



II 
II 
II 

) 

II 
II 
II 
II 
II 



II 
II 
II 



206 



189 



Response Ca tejgory 



How often used 
collection 
Used seldom 



own 



Used 
. Used 
Used 
NR 



occasionally 

frequently 

routinely 



How often used Search 

Indexes 

Never use 
Used seldom 
Used o'ccasiond^lly 
IJsed frequently 
Used routinely 
NR 

I 

Standard Abstracts 
Never use 
Used seldom 

Occasionally 
frequent ly 
routinely 



Used 
Used 
Used 
!lR 



In- house Abstracts 
Never use 
Used seldom 
Used occasionally 
Used frequently 
Used routinely 

^ NR' 



IftdusfTial Sample Acadefnic Sample 
Pre-test Post-test Pre-test Post-test 
N « 262 ^ N = 233 N = 70 N = 50 



7 
21 
46 
188 



36 
34 

5« 
47 
93 



3 
18 
58 
153 

1 



2 
8 

11- 
.48 
1 



27 
46' 

41^ 
61 
1 



NA 

II 



II 
II 
II 



5 
8 
36 



45 


40 


7 


6 


72 


83 


9 


5 


66 , 


"7 3 


18 


16 


51 


' 16 


. 15 


8 


27 


21 


19 


13 


1 


> 


2 


2 


53 


43 . 


NA 


NA 


78 


89 


fi 


It 


63 


55 


II 


tt 


31 


26 


II 


II 


34 


20 


II 


f II 


3 




II - 


1' 



NA 



II 
II 



How Often Used Abstracts 
and Contents 
Never use 
Used seldom 

occasionally 
frequent ly 
rout inely 



Used 
Used 
Used 
NR 



How Often Scanned 
Primary Sources 
Never use 
Used seldom 
Vsed occasionally 
Used frequently 
Used routinely 
NR 



NA 
II 

II 

II 

It 

It 



13 
32 
66 
63 
88 



NA 



13 
47 
63 
46 
63 
1 



3 
10 
14 
22 
19 

2 



2 
11 
18 
38 

1 



2 

6 

12 
15 
13 
2 



1 
9 
11 
28 
1 



ERIC 
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Response Category 



How often browsed ' 
Monsant<9<fsU) library 
Never use '' 
US'ed seldom 

occasionally 
f requentT3 
rout'ine 1 y 



Used 
Used 
Used 
NR 




jnjij s trial Sample 
Post-test 

N = 233' V 



p re-test 
N ' 262 



• 12- 
42 
79 

69 



18 
47 
78 

45 
44 

1> 



Academic SampjLe 
PE:jB-test^ Post-test 
N- =. 70 soN = 50 



'^17 

14 

1 " 



2 
10 
13 
15' 

9 

1 



How often used. 



Citations 






* 4> 




Never use 


25 


26 


r 


■ - — 


Used seldom' 


63 


56 


3 


3 


/Used occasionally 


77 


76 


13 


7 


Used frequently 


51 


42 


24- . 


19 


Used rout ipe ly 


44 


30 


2 7 


19 


NR 


_;2 - 


3 


2 


■ 2 


How often used Monsanto 










colleague j 










Never use 


8 


■ 6 


NA 


NA 


Used seldom / 


46j 


5 7 


.11 


11 


Us^d occasionally 


103 


84 , 


II 


fl 


Used frequently 


65 




II 


II 


Used routinely 


40 


32 


II • . 


.11 " 


- .NR 




1 


II 


II 


How oft^en used faculty 










memiber ^ 










Never us-e 


. NA,, 


/:' NA 


• 4 


4 


Used se Idom 




1 • .. II '-^ 


21 , 


15 


Use^ occasionally 


;ii ■*.-,': 


II • / 


25 


18 


Used frequently 


II 


\i '° 


11 1- 


5 


Used rout ine ly 


II 


ti 


8 


7 


NR ** 


II 




1 . 


1 



s tudent 



How often used 
Never use 

. - Used .seldom 

Used occasionally* 
Used frequently 
Used routinely 

^ * NR ' • 



NA 
II 



II 
II 

I! 



NA 



14 


7 


26 


2 0 


19 


15 


7 


4 


3 


3 


1 


1 



How often used friend' 

outside Monsanto(FSU) • 

N^er use 127 

Used- seldom 8 6 

Used occasionally 34 

Used frequently 6 

Used routinely 5 

NR 5 . 4 



109 
' 87 
28 
4 
2 
3 



22 
26 
16 
5 



15 
19 
11 
4 



.208 

t 



6 



191 



Response Category 



How often ^/uscd imme/ 
didte -^upervljor 
Never use 
Used seldom 
Used occasionally 
Used frequently 
Used routinely 
NR. 



Indus Academic Samp le 

Pre-test Post-Sfcest Pre-test Post-test 
N ^ 262 N =5 233 N = 70 N = 50 



12^ 




NA 


NA 




5 9 


5 6 


It 


II 




104 


87 


tt 


f» 




56 • 


- 47 


II 


li- 




30 


29 


II 


lt 




1 


2 


II 


- »t 





How 'often used another 
supervisor ' 
Never - use ^ 
Used seldom^ 

occasional ly 
frequently 
rout inely 



Used 
Used 
Used 

•NR : 



How often used non- 
student assistant- 
Never use 
Used seldbm 
Used occasional ly 
Used frequently 
Used routinely 
NR > 

I^w 'Often used 

Librajrian 
Neve r use 
Usf^d seldom 
Us.ed occasionally^ 
Us6.d frequently ' 
UsVd routinely 



i^sed \ 

h 
use 
seldom 

occasionally 
f requen t ly 
routinely 



How often used On-line 
data base (nSF service) 
Never use 
Used seldom P 
Used occasionally 
Used frequently 
Used routinely 
NR 




35 
99 
80 
33 
l3 
2 




-38 
109 
■ 62 

a9 

13 
1 



96 
92 
40 
13 
20 
1 



202 
44 
9 

. Z 
2 
3 



. 1' 
2 31 



NA 
II 

II 

II 

II 

II 



36 
69 
87 
27 
13 
1 



71 
( 86 

45 
■ 14 

i5 

■2 



109 '. 
59 
50 
12 

2 

1 

209 



NA 


NA 


II 


• 1 


' II 


** 


II 


II 






II 

r 


II 


, \ • 










Q 
O 


2 


1 


2 


1 


1 


1 


3 

1 

• ' - 


2 

< 


39 - 


2 7 


22 


17 


5 


, 3 


1 


- 1 


1 




2 


2 


NA 


NA 




II 




II 












II 




It 








41 




2 


6 


4 




1 






3 


2 



192 



Response Category 



"^How diten used current 
Awareness Service. 

Never use^ 
^ Used seldom t 

Used occasionally 
Used rout Inel^ 
NR . / • 

. . :/ - . . . 

How often used other 
on-line services 

Never use 

Used seldom 

Used occa s i o n a 1 1 y 

Used frequently 

Used rout ine ly 
>NR 



Tii dust rial Sample 



Pre-t est 
N - 262 



NA 
II 



56 
1 

3 

A. 
192 



Post-test 

N = 23^3 



NA 



167 
45 
18 

2 



Academic Sample 



Pre-test 
N = 70 



60 
4 
1 
2 
3 



14 



Post- test 

N = 50 : 



44 
2 



2 
2 



56 



42 



How useful own col- 
lect Ion 

Not used 
.Little help "^1^ 

Some help 

r^or tan t resource 
How 'useful search- 



How useful standard 
abstracts 

Not used 

L^lttle help 

Some help 

Important resource 

How useful Itn-house 
abstracts 

Not used 
' Little help 

Some — help 

Important resource 

. ,NR : ■ 




67 
89 

65 

37 
4 



42 
60 
103 
54 
3 



2 

8 
56 
16-5 
.2 



3 
16 
51 



62 
72 
73 
23 

3 



r 

46 

2 



"NA 



NA 

II 
tl 
II 



1 
12 

3 7« 



indexes • ' 










Not used 


5 9 . 


59 




7 


Little help 


, 81 


69 


' 11 ' 


9 


-Some help-- 


88 


77. 


20 


17 


Important resource 


31 




2 8 


16 


NR . . 


' 3 




1 


1 



NA 



NA' 



How useful abstract 
services - 

Not used * 

Little help 

Some help 

^mportant resource 



NA 
ft 



NA 



2 1 'J 



6 
9 
20 

34 
1 



4 
8 
14 

23 
1 



^ 193^ 

• / 



Response Category 



How useful scanning 
primary sources 

Not used 

Little help 

Some help 

Impor t^a^ t resource 
NR 



Industrial Sample 
Pre-test Post-test 

N =»' 262 N = 233 



Acadei(nj.c Sample' 
iSre-test Post-t:es\ 



N = 7 0 



N = 50 



>r^o 



How useful br^owslng ^ 
Monsbnto (FSU) library*^ 
Not us^d 
Little help i 
Some help f 
Important resoiAr( 



'ce 



How useful citations 
Not used ' 

" Ltetle help 
Sojie help 

Lmportant resource 
NR 

How useful Monsanto 
colleague 
Not used 
Little help 
Some help* 
Important resource 
NR ^ 

How usefuf faculty 
members ^ 

Not used 

Little help * . 

Some help 

Imp or t ant resource 
" NR 



How useful 4FSU student 

Not used 
*^ Little help. 

Some help 

Important resource 



How useful friend 
outside 

Not used 

Little help 

Some hfrlp 

Important resource 
NR 



27 
62 
115 
57 
1 



33 
63 
127 
36 
3 



45 
76 
76 
62 
3 



18 
62 

116 
64 

• 2 

/ 



NA 
i " 
n 
»t 



NA 

II 
11 
If 



146 
63 
42 
7 
4 



21 
55 
108 
46 
3 



26 
76 
92 
34 
5 



38 
58 
88 
4 4 
5 



A 

62 
108 
50 
2 



NA 

II 



NA 

II 
II 

II 



139 
56 
28 
5 
5 

2(1 



2 


1 


10 


9 


\ 16' 


10 


42 , 
— 


30 








9 


7 


23 


18 


28 


20 


10 


•5 
— 


1 


X 


7 


6 


27 


18 


35 
— — ; 


25 

— 


NA 


■ NA 


II 




II 


II » 


II 


II 


II 


li 






9 




17 




30 


i 19 


^4 

— — 


10 


23 


' 16 


22 


15 


19 


14 


6 


5 


/■ - 






26 


16 


11 


14 


10 


3 


2 


1 


1 



194 



RespoCTse Category 

How useful immediate 
supe.rvjibor 

Not tlsed 

Littl^ help 

Some fielp 

Important resource 



sef irl another 
sjupervisor^ 
No t used ^ ' 
Little help ' , 
Some help 

Important res o u r c e 
NR • 



industrial Sample 
P,re-tes t Post-test 



A c a d e m 1 c S amp 1 e 



4 N- = 

17; 
51 
130 
61 
3 



63 

67 
97 
32 
3 



262 



N = 233 

22 
55 
99 
54 
3 



49 
77 
75 
2 7 
5 



Pre-test 
N = 70 



NA 

rt 



NA 



Pos t- tes t 
N = 50 

,NA 
It 



NA 
II 



How useful non-student 

assistant (FSU) » 

Not used . 

% Little help ; 

. Somfr help 

Importaot resource 
NR 

"How useful Librarian 
Not used 
Little help- 
Some help 

Important resource • 

NR. 



How useful technician 
Not used 
Little tielp 
Some help 

Important resource "'^ 
NR 

IJov useful on-line data 
Not used 
Little help 
,S9me help 

Important re source^ 
NR ^ 



NA 
II 



63 
60 

105 
31 
3 



114 
67 
59 
18 
4 



207 
20 
17 
14 
4 



NA 
II 



60 

5 8 
8 2 
32 
1 



Ml 
'34 

■ 48 
36 
' 4 



60 

5 
2 
1. 
2 

51 
5 
9 
3 
2 



NA 

II 
II 
II 



*56 
2 
6 
4 
2 



43 
4 
1 
1 
1 

36 

5 
6 
2 
1 



NA 
II 

II 

»» 



43 
1 

3 
2 

i 



V 



How useful comp,uter 
Current Awareness 
Se^rvice (FSU) 

N^ot used 
' Little help 

Some' help 

Important resource 
NR 



flA 
II 



NA 
ti 

II 

ft 

ti 



61 

2 
1 
3 
3 



45 
1 

2 
2 



ERIC 



Response Category 



low usef 
spurces 



other 



In d u s t r i a 1 Samp 1 e.- ; 
Pre-te3t Post-- test' 
N ^ .262 N - 233 t 



A cademic Sample 
Pre -test Post-test 
N 70 N = 50 



\Not used 




'JO 


42. 


•j ,13 


fi 
O 


lylttle help 




2 


1 






. So^iCe help^ 




3 


4 


i "l- 




Important resource 


1 0 




! 1 




VP 




1 


182 


;• 55 


^ Z 


s 

Utility - local 








t 




^ va iiaoility 












Essential 




O J 


75 


\ 49 


o o 


Very. Important 




119 .V. . 


-106 


1 19 • 


14 


Some Importance 




47 ■ 


46 


.1 2 




noc imporcanc 




1 0 


4. — 




MDi ' 

N K' 

/ 


• 




• 2 




- 


uci±icy — up— to— 








( 




d^teness 








I 

i 




£*ssen t lal 




y o 


88 


* 47 


J z 


very important 




1 1 


114 


! 20 


1 c 

13 


Some- importance 




7 Q 


26 . 


2 


Z 


\ Not important 






,4 


1 


1 


NK 




.1 
X 


1 






Utility - response 


t ime- 










citation 












Essential 






29'-'W^ 


15 


IZ 


• Very important 




137 


'121 ! 


38 . 


26 


Some importance 




75 


70 , 


14 


11 


Not important 




9 


12 


2 


1 


NR ' 




2 


1 


1 




Utility - response 


time- 










full document 












Essen tial 




25 


17 ; 


14 


12 


- Very important 




119 i' 


108 : 


36 


23 


Some importance 




102 


94 ; 


16 


12 


Not important 




13 


13 


4 


3 


NR 




3 


1 ■ . i 







Util!ity - accuracy/ 

authority 
Essential 
Very important 
Some importance 
Not important 
NR y . "■■ 



137 
102 
19 

2 
2 



Uti^lity - comprehensive/ 

comple"t-e^ .' 

Essentially 83 

Very important 136 

Some importancV^ 38 

Not Important ' 2 

NR ' '^-^3_— 





63 
128 
36 

4 



44 
2 4 
2 



32 
32 
5 



32 
16 
2 



23 
22 
4 



Response Category 



Utility-direct use 
. Essential 

Very Important 

Some Importance 

Not Important 

NR 

Utility - other 
Esa^entlal 
Very Important - 
Some importance 
; Not important 
NR* 

First dhoice to keep up 
new developments 
Own collection 
Search indexes 
Standard abstracts 
abstracts 
primary 




In-house 
Scannint 
source 

Browsing Monsatito 

Library 

Citktion 

Morfsant 6 col lec t ion 
^friend outside / 
Immediate supervisor 
Another supervisor 
Librarian 
Technician 
On-line data base"? 
Other " 
N/A 
NR 



Industrlail Sample Academic Sample 
Pre-test Post-test PreVtest Post-test 

N = 262 N = 233\ IJ = 7*0 • N .= 5°0 



30 
88 
117 
26 
1 



2 
1 
3 
19 
2 37; 



10 
1^ 
28 
58 

88 

11 
3 
2 
3 
2 
1 

;o 

11 

3 
. 5 
9 



18 
66 
119 
28 
• 2 



3 
1 

12 
217, 



17 
32 
17 
4 



2\ 
"1 
2 



65 



15 
20 

ai 

. 4 



1 
1 
1 

47 



Own collection 
Search Indexes 
Abstract contents 
Scan primary source 
Brows IngFSU Library 
Citation 
Faculty member 
FSU student 
Friend outside 

Non-student assistant 

■Librarian 

On-line' data base 

Current awareness 

service , 

Other 

N/A 

NR 



3 
16 

■r. 3 9 



3 

r 
1 

3 



2 

•11 
28 



1 

3 



197 



Response Category 

First choice to find 
V7hat*.is in literature 
Own^ collection 
Search indexes 
S tandard abs t rac t s 
In-hou'se abs tracts 
Scan primary sources 
Browsing Monsanto 
Library l^y' 
Citation 

Monsant o colleague 
Friend outside 
Itnmed iate supervisor 
"Another supervisor 
Librarian 
Technic ian 
On-line data base 
~ Other 
N/A 
^ NR 

•First choice to find 
what is in literature 
s Own collection 
Search indexes 
Abstract contents 
^ Scdn primary sources ^ 
Browsing FSU Library 
Citations 
F'aculty -member 
FSU student 
Friend outside 
Non-student asst . 
Librarian 
Onirline data base 

Cutrent Awareness . . 

service 
^Oth^r 
„_^R / . « 

'First choice to brush up 
Own collection 
Search indexes 
Standard abstracts 
In-house abs tracts 
Scan primary sources 
Brows ing Monsant o 
Library' 
Cftation 

Monsanto colleague 
Fr iend^ outside 
tmmediate supervisor 
(Continued) 



Indus trial Sample 



Academic Sample 



Pre^test 

N = 26-2 

5 ' 
41 
64 

22\' 
37 

7 
1 

1 
1 

28 

33 
3 

8 . 
11 



Post-^test 
N = 2 33 



Pre-tesf 

N = 17 0 



P O S t - t (2 s.t 

N = 50 . 



40 
27 
30 
8 
49 

53 
2 
6 




IP 



15 


10 




33 


. 2 4 • . : 


US'- 


9' 


■ 5 




1 


.1 




1 


IV 




6 


6 




1 






1 


1 




3 


2 





ERIC 



Response •Catefiocy: : I>h4.us trial,; Samp3,- q. v Academlc Sample 

C" • Pte-'tfest Pgst-test 5Ye'-,test Post-tes*t 

N = 262 N 233 ; N = 70 = 50 



Another supervisor 
Librarian.; ' 13 ' ) 

Technician * * / — 

On-line data base ' . 12 

N/A . ' • . 4 



ther . - . 11 • ■ ■. : ' k. 

FiTst choice to^ brush , „ 

up on topic , , . . -I^ 

Own collection 

Search indexes 

Abstract contents - \ 

Scan primary sources 

Browsing FSU Library 

Citations ^ 

Faculty membet 
FSU student 
Friend outside 
.NcJn-st udent assistant 
Librarian ^ 
On-line data base 
Current Awareness 
Service 
Other 

First choice to look up 
specific facts for project 
. Own collex:tion "49.' 

Search indexes" ' , / 17 
. Standard Abs^tradt 19 

In-hause abstraqt .24 

Scan primary sources 13- 

Browsing Monsanto* 

Library 13 

Citation 3 

Monsan to colleague - - 31 

Friend outside '2 

I mme d i a t e s u p'e r y i s ci r 15 

Ano their supervisor 4 

Librarian , 2R 

Technician"" / - 

>On-llne data base 15 
^ Other ^ 6 

N/A ^ 7 

NR ' ' 16 



,17 








' 4. 




16 


. 12 




•7 


- 7 ■ / ' . 




4' 


.4 




4 


. • ■ 3 ' 




3 


. ■ - / 3 




5 






1 






3 ■ 






4 

< 


2 ■ 





o ■■ - ' • 

ERIC - 



R e s p o n g (g Gate fe o r y 



i; n d u s t IT 1 a I S a m p 1 e 
Pre-^test Post-t^st 
N =» 2 62 N ^ 23J 'i.' 



A c a d e m 1 c S a mp 1 e 
. ;'Pre- test' "Post- test 
tjll = 70 N = 50 



First choice to looC up 
. specific facts for . 
project 

Own collection 
Search Indexes* 
Abstract contents v 
Scan prljaary sources^ 
Browning FSU Library 
Citations 

JFacuIty member 
FSU student 
Friend outside 

Non-student assistant 

Librarian 

On-line data base 

Current Aw a r e li e s s 

Service 

Other . " 

NR . . ^ 

First choice for desCrlp-^ 
tlons of. procedures 
j^Own collec|lon 
Search lndex||s 
Standard abstract 
In-house abstract 
Scan primary sources 
Browsing Monsanto 
Library ^ 
Citation 

Monsanto colleague 
Friend outside 
Immediate supervisor 
Another supervisor 
Librarian 
Technician 
On-line data has^ 
Other 

'N/A " ' ^ 

NR 

First choice ft>r Descrip- 
tions of procedures 

Own collect ion 

search. Indexes. 

Abstract- con tents 

Scan primary sources ^ 

Browsing FSU Library '* 

Citations 
iPaculty member 

FSU student 
• (Continued) 



37 
13 
20 
25 
9 

17 

2 
36 

2 
19 

6 
21 

2 
14 

7 
16 
16 




1^ 



8 
5 
20 
19 
2 
4 
1 



1 
1 
6 



11 

2 
16 
18 

2- 

7 

4 



6 
3 
14 
14 
1 
3 



•5^ 



1 
1 



3(V 



. 1 

10 
13 
2 

5. 
3 



2/7 
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Respoctse Category Industrial Sample Academic Sample 

, Pre-test .^gost-test Pre-test Post-test 
- N = 262 N = 233 . = 70 N ^ 50 

Friend outside 



Non-student assistant — ■ 

Librarian — -1 

On-line data base ' - . < 2 2 

Current Awareness 

Service ^ 1 

Other 2 1 

Wa . 1 

NR ^4 4 

First choice to prepare for 
meeting In' company jjjfk- 

NA 
• II 



,v 



Own collections^ 


158 ' 




, NA 


Search Indexes 


^3 




It * 


Standard abstract 


- 2 




II ■ 


In-house abstract 


12 




II 


Scan primary source 


5 




II 


Browsing Monsanto 








Library 


8 




II 


Citation 






II 


Monsanto colleague 


6 




II 


Friend outside 


1 




II 


Immediate super vis Hir 


14 t 




II 


Another i supervisor 






It 


Librarian 


10 




. It 


Technician 






ft 


On-line ^data base 


3 




11 


Othfer 


■ 3 




II 


nVa . 


23 




II 


NR 


14 




II 



First choice for 
Internal report 

Own collection 172 NA NA 



Search Indexes 6 

Standard abstract 5 

In-house abstract 12 

Scan primary sources 6 
Browsing Monsanto 

Library 4 

Citation 1 ' " 

Monsanto colleague 2 ^ 

Friend outside 1 

Immediate supervisor 6 " 

Another supervisor — 

Librarian 10 - " 

Technician 1 ' " 

On-line data base 4 • " 

Other 3 

N/A 14 " 

NR 15 



ft 



II 



tt 



21$ 



201 



Response Category 



rnd us trial Sanple * Ac ad eml^c S atop 1 e 
Pre- test Post- test Pre-t est Post-test 



N = 262 N = 233 N 70 " N -^p" 



.'First choice to 
prepare for teaching 
Own Collection 
Search indexes 
Abstract contents 
Scan primary sourc'est^v 
• Browsing FSU. Library 
Citation 
Faculty member 
FSU student 
Friend outside 
Non-student- assistant 
Librarian 
On-line data base 
Current- Awareness 
Service 
Other 
N/A 
NR 



NA 



NA 



,27 
1 
2 

V.5 
■ 6 
3 
2 



2 
17 
4 



20 

1 
5 
5 
2 

2 



. 1 



First choice to prepare 
grant proposals (FSU) 

Own collection 

Search indexes 

Abstract contents 

Scan primary sources 
"Browsing FSU Library 

Citations 

Faculty member 

FSU student 

Friend outside 

Non-student assistant 

Librarian 

On-llna data base 

Current' Awareness 

Service " ■ 

Other 

N/A 

NR 



NA 



NA 



12 
5 
9 
9 
1 
1 



4 

1 

22 
6 



8 

3 
5. 
8 



4 
1 

20 



ERIC 



First ch'oice to pre- 
pare external paper 

Own collection 74 
Search indexes 11 
Standard abstract 19 
In-house abstract 1 
Scan primary sources 16 
Browsing Monsanto 
Library 7 
Citation 3 
(continued) 



2t^ 



Response Category 



Monsa nto co lle ague 
Friend outside 



Immediate supervisor 
Another supervisor 
Librarian 
Technician 
On-line data base 
Other 
N/A r 
NR 

First choice to pre- - 
pare external paper 
Own Collection 
Search indexes 
Abstract contents 
Scan primary sources 
Browsing FSU Library 
Citations ' ' 

Faculty member 
FSU student ' ' 
Friend , outside 
Non-student" assistant 
Librarian 
On-line data base 
Curreht Awareness 

Servtte r 
N/A a ' 

NR 

First choice to pre- 
pare patent application 
Own collect ion 

'Search indexes 
Standard abstracts 
In-house abstract 
Scan primary sources 
Browsing Monsanto 
Library / ' 
Citation 
• Monsan to colleague 
Friend outside 
Immediate supervisor 
Anothe.r supervisor 
Librarian 

Technic ian 

On-line data base 

Other 

N/A " 

NR 
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Industrial Sampi^^ AoidemicS^le 
Pre-test Post-test Pre-i^ Poa^-rfest 
N = 262 N = 233 N = 70/ N/^ 50 



12} 

15 
2 
80 
17 



99 
' 6 
15 
7 
6 

2 
2 

5 



1-3 
1 
55 
16 




14 
5 
15 
16 
2 
2 



1 
2 



1 
6 
6 



9 
3 
11 
13 
1 



1 
2 



Response Cat.egory 



Industrial Sample Ac a d emi c S amp 1 e 

P-X e-^ t es jL JB^-t - 1 e.st 



N = 262 



_-Eo-St"t est 
N = 233 



First choice to p're- 
pare patent application 

Own collection 

Sear.ch Indexes 

Abstract contents 

Scan pr Imar y s our ces 

Browsing FSU Library 

Citation 

Faculty member 

FSU student 

Friend outside 

Non-student assistant 

Librarian 

On-line data base 

Current Awareness 

Service 

N/A 

NR 



V 



N , = 

J 4 
1 
4 



.70 



1 
46 
11 



N , = 



1 

— fi 



50 

d 



43 



•First choice to prepare 
literature review 

Own collection 
. Search Indexes 

Standard abstract 

In-house abstract 

Scan primary sources 

Browsing Monsanto 

library 

Citation 
^Monsanto colleague 
-Friend outside 

Immediate supervisor 

Another supexvisor 

Librarian 

Technician 

On-line data base 

Other - 

N/A 

NR 

First choice to prepare 

literature review 
Own collection 
Search Indexes 
Abstract contents 
Scan primary sources 
Browsing FSU Library 
Citation 

Faculty member j 
FSU ;^t«dent - S- 
(cdntlnue ) 



4. « 

9 
27 
44 
10 
12 

9 
2 



37 

45 
1 
51 
15 



5 
8 
23 
3 
2 

\ 1 



2 
6 
19 
2 
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Reftponse Catepory ^ ' Industrla-1 SamV l. Academic Sample 

Pre-test Post-test Pre-test Post-test 

. ^r-' , • ' N - 262 N = 233 N '« 7(y N=50 

Fri end outside ^ w 



Non-student assistant 
Librarian 
On-line data .base 
Curr en t Awareness 
, ' Service 
Other 
. N/A 

JR . - " 
^ f / " . 

First choice of all 
, sources , 

Own collection 116 
Search indexes 12 
Standard abstract 25 
In-house abstract 14 
'Scan -primary, sources 22 
Broyning Monsanto 
Library . 5 

Citation 1 
Monsanto colleague 4 
Friend outside . i 

Immediate supervisor 4 
Another supervisor 
Librarian 2I 
Technician 

On-line database 30 
Other 

NR 7 

First choice of all 
sources \ 
Own collection 



2 1 
1 
10 

8 13 



7 6 
3 
16 
13 

< 1 
2 1 



Search indexes g 

Abs trac t contents 2 2** 

Scan primary sources 19 

Browsing FSU Library * 1 
Citations '< - 

Faculty member ^ ^ 2 • 1 
FSU student 

Friend outside _3 

Non-student assistant 

Librarian 

On-line data base 43 
Current Awareness 

•^^^^ice . ^ 5 , 

Other ^ y - 

NR' : , 7 ^ 



2ZZ 
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Resource Cat e gory 



I n d u s t r i a ir S a mp 1 e 



Librarian 

'Tei^hnician 

On-line data 

Other 

NR 



base 



\xPre-test 

24 
1 
14 

/ 4 
12 



Post- tes t 

233" 



Third choice of all 
sources 

Own collection 

Search indexes 

Abstract contents 

Scan primary sources. 

Browsing FSU Library' 

Citations 

Faculty member 

FSU student 

Friend outside 

Non-student assistant 

Librarian 

On-line data base 

Current Awareness 

Service / 

Other . ■ ^ 

NR 

Last choice or least de- 
sirable sources 

Own collection- 9 
Search indexes 17 
Standard abstract 22 
In-house abstract 10 
Scan primary sources 22 , 
Browsing Monsanto 
library 21 
Citation ' . ^ 4 

Monsanto colleague 14 
Friend outside 
Immediate supervisor 5 
Another supervisor 8 
Librarian 17 
Technician 40 
On-line data base 15 
Other - 2 
NR • 27 



Ac ademic Samp 1 e 
Pre-rtest Post-test 



= '7"0 N 50 



J 



14 
11 
10 
13 
7 
2 
> 



9 
8 
8 
10 
3 
2 
4 



2 

1 

3 



2 
1 
3 



Least desirable sources 

Own collection _^ 

Search Indexes ^. __ 

Abstract contents — 

Scan primary source _-i 

(Cont Inued) ' 



ERIC 



t 

2^3 



2d6 



Response Categ b^r y 



•Second choice of all 



• Indus t rial Sample 
Pre-tes t Post- test 
N = Z62 N » 233 



Academic Sample . 
Pre-test Post-te*st 
N = 70 N « -50 




sources 

-7~0wu collecrlr&ri^ :~ 

' Search indexes 
Standard abstract 
In-house abstract 
Browsing library 
Scan primaty sources 

Citation . 
Friend outside 
Immediate supervisor 
Another supervisor- 
Librarian 
•Technician 
On-line data base 
Other 

NR r 

Monsanto colleague 

Second choice of all 
ources* ' 
Own collection 
Search indexes 
Abstract contents 
Scan primary sources 
Browsing FSU Library 
Citations 
Faculty member 
FSU student 
Friend outside 
Noh-st uden,t ass is tan t 
Librarian 
On-line data base 
Current Awareness 
Service 
Other 
NR 



Third choice of all 
sources 

6wn collection 

Search indexes 
. Standard^ abstract 

In-house abstract 

Scan primary sources 

Browsing Monsanto 

library 

Cita,tion 

Monsanto colleague 
Friend outside 
Immediate supervisor 
Another supervisor' 
(continued) 



~T7 
24 

34 
29 
19 
40 
5 



17 
1 

24 
7 

li 



22 
21 
24 
41 
30 

22 
7 

20 
3 

14 
3 



10 
9 
16 
18 
2 
3 
1 



8 
8 
12 
13 

2 
1 



8 
1 
2 
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Re-sponse Category 



Indus trial Sdmp le 
Pre-test Post-test 
N = 262 ' ir= 233 



Academic Sample 
Pre^test Pro-test 
N = 70 N « 50 



ERLC 



BT-owsinrg-:^^l^41>raryv 

Citation j 
Faculty member ""^ 
PSD student 
.Friend outsii^e 
Non-student iisslstai^ 
Librarian 
On-line da.ta^^Jj^se 
Current Awar^^ess 
Service ^>5? , 

Other 

NR . ' ^ 

In,f ormal discussion 
Subs taut ialljT^re 
Somewhat more 
About r h-t— — 
Somewhat less v^'' 



Subs t ant ial ly 



l^ss 




Access to publi^^? 
information 

Substantially more 

Somewhat mo|:^ 

About rfght 

Somewhat lesV 

Substantially 

N R >^ ; 



p4- 



41 
111 
107 




Access to in-house reports 



Subs t ant i ally; tnore 
Somewhat morq ^ 
About right 
Somewhat leas 
. Subs tant ially\ less 
NR 

Advantageous to do ' 
own in^ormationf search 

S t rongly agree 

Agr6e somewhat 
. Disagree somewhat 

Strongly disagree 

NR ' r'^ 

Present information 
locating means adequate 

Strongly agre.e 

Agree sinewgac 

Disagree somewhat 
* Strongly disagree 

N|l * » * 



23 
7 4 
159 
3 



■a: 



22S 



1 

'5 
4 
31 
12 
1 



13 
24 
32 
1 



30 
29 

:ii 



6 
14 
37 

2 

^ 5 
.6 



5* 


35 


39 


171 , 


131 


26 


27 


57 


4 


6 


3 


1 




7 




17 


4 9 


4 


147 


L38 


38 


7 9 


34 


2\ 


lA 


5 


2 


5 


7 





I 

3 
4 
23 
8 
1 



8 
20 
22 



22 
21 
7 



6 
11 
25 

3 
5 



18 
27 
2 
1 
2 




'0 



Response Category 

Librarian useful 
Strongly a gree 



' Industri al Sample A cademic Sample . 
Pre-test Post-test Pr7-test Post-test 
N « 262 N » 233 N = 70* N » 50 



Agree somewhat 
Disagree somewhatTb 
Strongly disagree 

Forefront of knowledge 
Strongly agree 
Agree somewhat 
Disagree somewhat 
Strongly disagree. 
• NR 

Present sources 
adequate « 

Strongly agree 

Agree somewhat 

Disagree somewhat 
_ Strongly disagree 

NR 

Present soiirQes 

t lme-cons\imlng 
Strongly agree 
Agree somewhat 
Disagree somewhat 
Strongly disagree 
NR 

Present sources 

up-to-date 

Strongly agree 
Agree somewhat 
Disagree somewhat 
Strongly disagree 
NR 



Used on line 
Yes 

No , . 

NR 

If no » familiar 
Yes 
No 
NR 

^On-line an improved 
method • * 

Yes 

No ^ 

Don't know 
NR 



1 2 '8- 



114 
12 
1 

> 7 



34 
114 
80 
24 
10 



53 
157 
41 
7 
4 



10 
75 
140 
2 4 
13 



40 
172 
29 
9 
12 



31 
228 
3 



83 
153 
26 



104 
14 
141 
3 



-15^0 
75 
3 
1 
4 
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-19- 
38 
12 
1 



31 
31 
5 



14 
40 
14 
2 



6 
29 
28 
'3 

4 



10 
43 
15 
1 
1 



17 
53 



27 
27 
16 



41 
1 

27 
1 
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ra 

7 
2 

. 1 



' 10 
40 



17 
23 



27 
1 

21 
1 
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Response Categoiry I o d us t r i W.S a mp 1 e " Academic Sample \ 

' *Pr'e-tes t ?iff*H:—test Pre-test Post-test 
.n' = 262 N = 233 N = 70 Nt^ 50. ' 



4^o-ten-^l^a^-utd^^^i^y--af ' . — ; — 

on-line searching \ 
(open ended) ' 
Don't know (need 

more ' In format Ion , - ^ . . ^ N 

wait t Of see need 

to use ) 14. ^ 4 

Would like to try It • 1 4 
Positive expecta-- * i . 

tions/ugeful 114 * ' '27 

Negative expecta- 
tions/not useful • '-8- 1 . . 
Good service but 
not useful for my 

work 8 1 

Good service, don't * 
know If yseful f^or <^ 
my 'work 10- 
Useful with reser= 

vat Ions 26 "^'124 

All othen comments 5 . 

NR 76 21 



Monsanto Facility (Mfc) 

Pehsacola 171 
Blacks burg, South 
Carolina ' 1 

Decatur, Alabama 34 
Durham, North 44 
Carolina (Research 
Triangle, Triangle 
Park, MTPDC, MTPDCI, 
dtd.) 

Greenwood, South 

Carolina 5 

Sand Mountain , 

Alabama 1- 

Other 1 

NR 2 



J 



ERLC 
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r 



Post-test Post-test 



MTC 



Online adequacy, -"literature coyer a g e 



FSU 



Subjects Inclu^i^d: 
Very good 
Good 
Fair 
Poor, 
Very poor 
NR 



45 
105^ 
30 

3 

4 
46 . 



28 
14. 
2 
1 



Specific titles: 
Very 'good 
Good 
Fair 
Poor 

Very poor 



V 



48 
108 
26 

2 
47 



25 
17 
3 



.,Up - 1 «5-dat.eness 
Vjery good 
Good 
Fair 
Poor 

Very poor 
NR 



of literature 



54 
102 

28 
1 
1 

47 



24 
17 
4 



Ret rospective 
Very'good 
Good 
Fair 
Poor 

Very poor 

NR • 



searching 



13 
68 
63 
. 34 
9 
46 



1 
14 
21 
5 
4 
5 



Online adequacy '- interaction with 
3V 3 1 em 

' Service hours : 
Very good 

Goo d . , . I . 

Fair . 
Poor 

Very poqr, 

NR . . 



Performance 
special'lsts 

Very good' 

Good 

Fair 

Poor 

Very poor 
NR 




Qhes by 



68 
100 
19' 
1 

- 1 
50 



91 
76 
14 

1 
51 



18 
19 
5 
2 



32 
8 
4 



I 



V 



ERIC 
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Information provided 'about 



Post'-t est 
. MTC 



Pos t-tes t 
FSU 



\ 



system: 
Very good 

.Good . 
Fair 

Very poor 
. ' NR 

^Subje-ct access (keywords', 
descriptions) : 
'Very good 
Good . 

• Fair 
Poor, 

Very poor, 

NR • ' / ' 

Other access pointsl 

• Very i good 
^ Good 

Fair 
Poor i 
Very poor 
NR 

lEase of use; 
Very jgopd 
Good 
Fair 
Poor , 
Ver^y poor 
NR 



Online adequacy - Search results 
Time to obtain results online: 
Vetfy good 
Good 
Fair 
' Poor 
. Very poor 

NR ' ^ 

Time to obtain results offline; 
Very good 
Good 
Fair 
Poor 

1^ Very poor \ 

' N-R 



63 
87 
31 
2 
1 
49 



26 
108 

40 
4 
2 

5 3 



18 
101 

5 0 
3 
1 

60~ 



42 
94 
40 
3 
1 
53 



72 
7 9 



2 
56 



37 
90 
41 
4 
2 
59 



27 
12 
3 

2 . 

■^'-/ 

/ ' 

/6 - 



12 

1&' 

12 

1 
- 1 

6 



16 
19 
6 

, 2 



24 
12 
6 



39 
.3 
1 



18 
19 
3 



10 
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Completeness of search results: 
, Very good ' ^ * 



Post- test . Post- test 
MTC \ FSU 



. , Good 
• Fair 
Poo't ' ■ ' - ■ 
• Very poor - 

. . .NR . ■ , --■„ • '-M- 

■ .. ■ ' ■■ ■ - ■ .^-j'^-^H 

Exclusion of non>-r ele vaht'^i> 
clta t ioAs ; 
Very goad 
Gp od 
' . -^Fair 
^Pbor 

Very poor 

.■ -NR . ■ i ^ ' ,\ 

Full-text availability jLn' ' \ " ^ 

personal collection: . ' " : 

Very go 14 . 1 

Good • . ' Y'S ^ 18 

/ Fair ' 57, 14 

Poor _ 18 , 8 

Very poor- \ 8 1 

' ■ NR" ; ; ■ V, , : - ^ 5 8" \ V' ■ ,8 

Full-text availability in 

library; . . • ' . ' v' 

Very; good ' 10 ' ^. 6 

Good _ 92 / ' ^8 

. ... . Faix \. .. ■ * . '. „ : • ^ ,^^ 62 y : . 15/ 

Podr ' 11 • 2 

Very poor - ^ . 3 V ^ 2 

. * -NR ./ ; - i ■ 55. /..y 
Full-test av;ailat>ility by 

inter-library loan: ^ a. 

Very good ^ , 52 ^ 11 

Good " ' 79 16 

Fair . 35, - ' 7 

Poor \ ^2 ^ ^3 

. -V^ry poor \^ . ► ^ ^ 2 -- 

, NR 63 V 13 

.'V ■ . va ' 

Utility of online blbliagraphic ' ^ 

services " ' ■ ■ ' ^ J . ■' ■ ■ '.'^ 

To keep up with new developments:. ,^ ^ 

Best method a\^ailable 25 ' 1 

Very useful ' / • T 110 , 24 

^ Somewhat useful ^ 64 " . 15 

Not useful . ' 10 - 1 

NR. , ' • • 24 ' ' 3 



ERIC : ^ , _ • ;?3^ 



2 3 


" 13 








104 


21 ' 








^47 


■ . - 7 








^4. 


• ■ -l- 
■ ■■■■■1. ■ 


— ' ■ 






54 ■ 










* , 










. . ^ 9? 


■/l ■ 








58 ' 


18 








9 5 . 


18 








•-14 










3 










54 


1 . 
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Post-test 
.MTC ■ 



Pos t-test 
, FSU . 



is reported on 



To fin<J what 
a ' topic : ■ 

Best method available 

Very useful 

Somewhat useful 

Not useful 

NR 

To brushup on a topic i" 
Be s t^eTttfrftd-^a va liable 
Very ' useful 
Somewhat useful 
No t use f ul • 
NR 

To look for specific' facts 
. . Best method available 
Very useful " 
'Somewhat useful ' . . 
A Not useful 
NR » 



To find descriptions of pro- 
cedures : 

Best method available 

Very useful 

Somewhat useful 

Not useful 

NR 



51 
113 
43 
3 
23 



28 
110 
60 
11 
24 

26 
101 
73 
11 
22 



20 

71 
98 
18 
26 



16 
26 

4 
1 
3 



10 
22 
14 
1 
3 

10 
16 
18 
2 
4 



5 
17 
21 
3 
4 



for meeting in 
avai lab le 



To prepare 
company : 

Best method 
. Very useful 

Somewhat useful 

Not useful 

NR ' ^ . 

T9 prepare for teaching: 
,Best method available 
Very useful 
Somewhat useful 
Not useful 
NR ■ 

to prepare internal report 
Best method availabl.e 
Very useful 
Somewhat useful 
Not useful 
NR 



1 



6 
38 
121 
45 
23 



NA 



7 
58 

123 
21 
24 



NA 



4 
19 
17 
10 



NA 
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To prepare grant proposal; 
Best method available 
Very useful ' 
Somewhat useful 
Not useful 
NR 

To prepare external paper: 

Best method available 
' Very useful 

Somewhat useful 

Not useful 

NR 

To prepare patent application: 
Best method available 
Very useful 
Somewhat useful* 
Not useful 
NR 

To prepare literature review: 
Bes t available 
Very useful 
Somewhat useful 
Not useful ^ 
NR 

Finding citations easy without 
online : 

Strongly agree 

Agree somewhat 

Disagree somewhat 

Strongly disagree 

NR 

Findin"g citations easy with 
online: 

Strongly agree 

Agree somewhat 

Disagree somewhat 

Strongly disagree 

NR 

Prefer to delegate literature 
searches :' 

Strongly agree 

Agree somewhat ^ l> 

Disagree somewha t 
Strongly disagree 
NR 



Post-test j 
MTC • 

NA 



20 
10 6 

70 
14 
23 



67 
112 
25 
5 
24 



6 
67 
109 
25 
26 



54 
125 
23 
4 
27 



38 
90 
75 
25 
5 



Post-test 
FSU 

4 

V24 
13 
3 
'6 



21 


4 


110 


28 


58 . 


12 


21 


2 


23 W 


4 



1 

T.0 
.12 
10 
17 



18 

23 
4 



3 
Id 
2*7 
6 
3 



21 
22 
4 



1 

12 
21 
15 
1 
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Post-test; Post-test 

MTC FSU 

Online searches allow more 

reading time ; * ' 

Strongly agree _ 67 16 

Agree somewhat 122 26 

Disagree somewhat 28 5 

Strongly disagree 3 T 

NR I ' 13 2 

Online searches allow less 

time for searching literature: 

Strongly agree 74 21 

Agree somewhat 93 14 

Disag'ree somewhat 36 9 

' Strongly disagree 17 5 

NR 13 1 

- - t 

Online re^4)ance gives misses 

citation:^ ^ 

Strongly agree 36 13 ^ 

Agree somewhat 121 

Disagree somewhat 56 . 12 . 

Strongly disagree* 5 . 2 

NR 15 2 

Delegate formulation of 

online search 'strategies : 

Strdngly agree 38 2 

Agree somewhat . 99 * 15 

Disagree someuitiat c-5 64 ^> 19 

Strongly disagree •> 18 12 

NR ^ * 14' r 2 

Should manually double-check , ^ 

onlineresults: ^ ^ 

Strongly agree' r 8" 3^ 

Agree somewhat - 81 13 

Disagree somewhat 94 23 

Strongly disagree ' 27 8 

NR 23 3 ' 

Online searchesin crease ^ 

product iyity : 

Strongly agree 43, 15 

Agree somewhat 141 27 

Disagree somewhat 27 . 6 

Strongly disagree 4 1 

NR 18 1 
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Online searches too tlii)« 

consuming : 

•Strongly agree 
Agree somewhat 
Disagree somewhat 
Strongly d 1 s a g r£ e 
NR . 



Post-test 
MTC 



17 
120 
75 
21 



Post-test 
FSU 



5 
20 
24 

1 



Too many useless foreign 

articles; 

Strongly agree 
Agree somewhat 
Disagree somewli'^t 
Strongly disagree 
NR 



■13 
78 
79 
37 



16" 
16 
14 
2 



Prefer to do own online 

searching : 

Strongly agree 
Agree somewhat 
Disagree somewhat 
Strongly disagree 
NR 



10 
'42 
104 
58 
19 



2 
11 
21 
14 

2 



Company fbnds should pay for 
online: 7 

Strongly agree 

Agree somewhat 

Disagree somewhat 

Strongly disagree 

NR 



9 0 
8.7 
25 
13 
18 



Own cost-center should 
Strongly agree 
Agree somewhat 
Disagree "^omewhat 
Strongly disagree 
NR 



pay 



106 
79 
23 
9 
16 



Department funds- should 
Strongly aigree 
Agree somewhat 
Disagree somewhat 
Strongly disagree 
NR 



pay 



12 
16 
16 
3 
3 



Grant / cont rac t funds 
Strongly agree 
Agree somewhat 
Disagree somewhat 
§trongly disagree 



NR 



L 



to pay 



12 
21 
10 
2 



it 
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Post-test Post-test 

MTC FSU 

Willing to pay out of pocket: 
Strongly agree 

Agree somewhat \ -- 12 . 

Disagree somewhat n 

Strongly disagree -- 24 



NR 



Course preparation.: 
0 

1 

2-3 
NR 



3 



How many papers, reports 

prepared: i 

0 105 8 

1 o . - 25 7 
2-3 51 17 

, ^-5 28 7 

6-10 6 7 

11-20 3 2 

NR . . , . 15 2 

How many grant /contract 

proposals : j . * 

0 192 27 

1 . -58 
2-3 11 10 
4-5 • 1 2 

6 + r ,v 3 

NR - - 21 3 

Preparation of non-published " 
reports: 

0 71 29- 

1 '- 24 9 
2-3 47 3 
4-5 ' 24 2 
6-10 26 2 
11 + 10 1 
NR "'31 4 



33 
10 

5 

2- 



98 6 



Number of papers, reports 
requiring literature search: 
0 

1 27 8 

2-3 39 19 

^-5 12 X. 4 

6-10 * 1^7 

NR . 56 6 
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Number of papers, reports that 
used online searches; 
0 

1- ^ ■ ' ■ 

2- 3 
4-5 

. 6-10 ' 

Number of grant/contract 
proposals requiring ' 
literature searches: 
0- 

l'( 
2-3 , 

4-5 




^X. of proposals that 
r..onllne searches: 

1 ■ 
2-3 , 
4-5. 

NR " • ■ 



Pos t'-tes t 
MTC 



139 
19 
14 
1 



- St 



60 



130 
9 
3 

91 



136 

.'•..:,5' 
1 

91 



Number of technical reports 
requiring literature searches 

0 

1 

2-3 
4-5 
6-10 
11 + 
NR 

Number of technical reports 
using online searches 

0 

1 

2-3 
4-5 
6-10 
NR 

Number of other activities 
requiring literature searches: 

0 

1 

2-3 
4-5 
6-10 
11 + 
NR 



92 
30 
43 
14 
7 

47 



121 
38 
19 
2 

53 



20 
17 

2:2 
4 
5 

165 
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A 


P orf^ ^ t es t 


Pos t- tes t 




fix L 


FSU 






* 


using online searches: 






0 ^ 


30. 


7 * 


1 . \ 


1 Q 

X C) 


4 


2-3 


X O 




O X u 


5 
1 


1 , 


NR 

** 


1 A 1 
XX) X 




Numtf^er of course preparations 






using online searches: 






0 





^ 33 


1 




1 






1 




■ : 1;, ' 


, .15 








Utility 




16 


\^«^iiipjLC uciicao CAllaU9 uXVcricSS 


1 9 


4 


Good for keeping current 


♦ 9 


' 5 


Convenience 


9 , 


^ 7 ^ 


-Dtociu coverage or sources 


9 


1 


Inc;reases productivity 




, 3 


• «s*-jr uocxux 'WULK.O wexx 
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Dear Colleague , . 

This is to Introduce you to an FSU Study with the participation of the 
PSU Chevlstry Department, supported by the National Science Foundation, which 
is intended to assess the effect of on-line computer searched bibliographic 
data bases on the information style of chemists. Portions of Chemical Abstracts 
and other indexes such as the Smithsonian Science Information Exchange (SSIB) 
"X* the American G eological Institute (GEOREF) can now be i.Anrrh«»H *t- >.nmp..^»r 
terminals by author, subject, and other access points. Within a matter of 
minutes, citations of potentially relevant documents are printed at the terminal. 

We are interested in learning whether the availability of such a search 
. service in the Chemistry Building will assist you in selecting information for 
(<>y6ur professional tasks. Plans are to install a computer terminal in mid-Kay. 
° We will provide free computer searches , at first performed by information 
specialists and then cenducted on a self-service basis. 

We need to learn about the way you seek scientific information befoife 
introducing the coaqtuter terminal and at the concluision of the study, which 
will last at least until the end of 1976. We would, like to obtain the needed 
information with the aid of the attached questionnaire and short interviews . 
Whether or not you now plan to use the computer search service, please fill ' ^ , 
out the attached questionnaire and return it by April 21st in the enclosed 
envelope to Gery Jahoda, Room 35 Strozier Library. 

We are looking forward to working with you and appreciate your help in ' 
filling out the questionnaire. Please call Gery Jahoda (4-2242) or Al Bayer 
<4-2833) if you have any questions about the study or the questionnaire. 

Sincerely, 



cm 



Al Bayer 

Institute of Social Research 



Gery Jahoda 
School of Library Science 
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' • ■ • ■ ■ / ■ 

^ . . . • / 

SffRVEY OP THE INPORHAnON STYLE OP PLORIDA S^TE UNIVERSITY CfflSMISTS 



1# Your nmt^x ^ 



2. Tour sex: Kale_ Pemale f 



3. What Is the highest level of formal education yo^i have attained? 
(Circle appropriate letter). * - 

• I? I / 

A. BA, BS I I / 

B. MA, MS 1 0 

C. Doctorate without dissertation 

D. Ph.D. 

E. Other doctorate 

P. Other (please specify f_ ^_ \ 



4. Miat is the major field of highest degree you |£»v hold? 

5. Year to nhicli highest presently held degree vi(is^^ obtained: 19 

6. Calendar year from whic|i you have been contin&msly in association with 
PSn (todudtog leaves of absence) : 19 [1 ■ 

7r Which best describes your present position at PSU (please circle one): 

A. Pull Professor 

B. Associate Professor 

C. Assistant Professor 

m 

D. Ins true tor /Lecturer ^ 

E. Postdoctoral Pellow 

P. Doctoral Candidate or Doctoral Student 

G. Research Associate 

H. Other (please specify: 
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SllS ^ I! TT*! "''y ^^^^'^^^ ~ average, do you actually 

l^ilJ^^ following activities reUted to ylnv position airZ, 



A. Administration 

B. Locating Information^ 

C. Reading professional 
literature 

D. Laboratory research/ 
data analyslsj and 
co^mter proci 



Writing or preparing 
research reports or 
^ prof asalonal papers 

F. Institutional or 

departmental meetings 

C. - Informal discussions vlth 
colleagues 

H. Teaching (Induing preparation, 
lecturing and testing /grading) 

I. Advising snd cotuisellng students 
(Including Individual student's 
committees) 

J. Attending class as a student 
and related studying activities 

K. Other (please specify: * 
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4 5 6 7 8 9 10 

4 5 6 7 ' 8 9 10 
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Mark all types of work t^ttat you have engaged In for a year or more 
since earning your highest degree (do not Include part-time* work 
while In graduate school). 

Mark the one type of primary work you were engaged In Imaedlately 
prior to coming to Florida State University? 



a. Teaching or administration In an 
. 'elementary or secondary school. 



iri^ji^; teaching In a college or 



c. Fiill-^tlme research In a college or 
university. 

Teaching and research In a college 
or university. 

Research and "development In business 
or Industry. 

f . Research and development In a 
•governmental asency . 



8- 



Executive or admlitl^ratlve 
position outside edlucatlon. 



h. Other professional position 
(please specify: 



1. Student. 

J. Other (please specify: 



All typeB; 
of worfc^ ; 
(chepk^l 
thax at 



.:'i:fT^iakry work 
before Coming 

V' to :-;fso 




b 
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10. 



Indicate hov frequently you used 
sources of Information during t 
appropriate response for each 1 




'■■•>'^'*' . " « \ .' .. 

■''^Ki-- • ' ■ /■. ■ • 

f r f he sources on the. list of 
^ar. Pleasci/ circle the 



IS^sburce.. 



A. Your own colU^tion of Infonnatlon, 
I.e., your periional files, v " 

B. Your own search through Indexes to 
the literature, e.g., Cheiflcal Titles. 

C. /'^i^ <nnu^g^^g of abstract bulletins 
or table services V e.g.. 
Chemical AHP|||^^^urr€|nt' Contents. 

D. Your own scanning of primary Journals 
or other primary sources. 

E. Your own browsing In the FSU Strozler 
Library. ' 

F. Your selection of a publication from 
^ a citation In another publication. 

C. From a faculty member at FSU. 

•H. Prom a student at FSU.- 

I. From a colleague or friend outside 
of FSU. 

J. From a non-student technician/laboratory 
assistant. 

K. From an^FSU .^tro^.iet librarian. 

L. From an on-line searched bibliographic 
data base. 

M. From a commercially computer searched 
current awareness service, e.g., I.S.I, 
machine searched current awareness. 



if , 

SI 

I 

N 



N 

/ 

N 

N 

N 

N 
N 



H. Other (please specify: 



_) 



N 

N 

N 

N 
N 



<H QQ CO 

fH O 

41 CM o 

CO , O U 
U 

"O o *a tn 

w »H CO cn 



01 ^ 

25 



^ . . CO \o 



)'0 



s 
s 
s 



0 
0 
0 



s 
s 



0 
0 



s 
s 



0 
0 



OB ^ 
P ^ 

F 



I 

u ■ 

S" 

urn 

■ ■ u 
•o o 

R 



F 
F 



F 
F 



F 
F 



R 



R 



R 
R 
R 



R 
R 



R 
R 



ERIC 



225 



11. Indicate how useful each of the sources on the 
\the requirement of the project (s) in which you 
past year. Please circle appropriate response 



list below was for meeting 
were engaged durit^ the 
for each listed source. 



A. Your own collection of, information, 
i.e., your personal files. ' 

B. Your own search through indexes to 
the literature, e.g.. Chemical Titles. 

C. Your own scanning of abstract bulletins 
or table of contents services, e.g.. 
Chemical Abstracts, Current Contents. 

D. Your own scanning of primary journals 
or other primary sources. 

E. Your own browsing in the FSU Strozier 
Library. 

F. Your selection of a publication from a 
citation in another publication. 

C. From a faculty member at FSU. 

H. From a student at FSU. 



I. From a colleague or friend outside of FSU. 

J, From a non-student technician/laboratory 
assistant. ' . 

K. From an FSU Strozier librarian. 

L. From an on-line searched bibliographic 
data base. 

M. From a commercially computer searched 
current awareness service, e.g., I.S'.I. 
machine searched current awareness. 



r 





CM 




t 


1 


IT) 






1 




O iH 


O . 




0) 
















o . 






c 










•o 








CO -H^ 


n o 


Q ' 






1 


,2 


3 



1. 
1 
1 
1 

1 
1 



N. Other (please specify: 
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Evaluate the utility information sources in termqf of your information 
needs and preferences. (Indicate the Importance you assign to each of 
the listed factors). 
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Local availability. 
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Up-^to-dateness . 
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Response time In obtaining 
citation/abstract. 
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Reeiponse tiine In obtaining full 
copy of original document. 
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Accuracy/ Authorltatlveness 
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Comprehensiveness /Completeness 
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Direct useablllty without 
librarian assistance. 
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Other (please specify: ) 
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13. ror these activities listed belou In which you occasionally engaged. If 
only_one Information source could be used, which Vould you choose? 

(Indicate by placing the le tter standing for the tnformpffnn source . 

listed In question 11. Report an Il/A,lf the activity Is not applicable 
to your work In the past y,ear) . 

- a. To keep up^th new developments on a topic '■ 



b. To find .out what Is reported In the literature on a topic 

c. To brush °up on a. topic . , 

d. To look for specific facts related to on-going project 



e. To look for descriptions of procedures related to an on-going 
project ; . • j 

f. To prepare for teachlng_ . - ■ 



g. To prepare grant proposals or 'grant reports 

h. To prepare a paper for external presentation or publication 
t. -To prepare a patent application _. 

J. To prepare a review of the literature ^ . 



14. A. If , you were limited to Che use of only some Information sources on the 
list of question 11, which ones would you choose?- Mark answer by 
placing the letter standing for the information source that would be 
your first choice, your second choice, and your third choice. 

First choice : 

' \ ■ , ■ ■ • : ■ 

Second choice; 

■•"■.* • • . *" 

Third choice: / 



B. Of all the information sources on the list in question 11, which one 
would you choose last? 



Leaat desirable: 



1 
5 
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y 

15. 



Evaluate the following possible ^^^Kes in your work setting with respect 
to their potential for in^rovlu? ^^^^ ^^k^jp a scientist. Indicate your 
eva^^tlon of whether more or 1^^® ^ould biHenef iclal for each Item by / 
cttcllng the appropriate letter* — -J 



A. Informal discussion with col^^^^^s 

B. Access to published Informatl^^ 
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C. Access to FSU scientific re^^"^^ 
reports 



B 



16. Indicate your attitude concernli»8 each of the fcllowlog statements b;, 
circling one of the following Strongly agree <SA) , Agree 

somewhat (AS) y Disagree somewhat ^^^^ » Bnd Strongly disagree (SD) . 

A. It Is advantageous for a scl^^^^^ to 
perform liis/her own Informad^'^ ®®areh. 

B* My present means of locating ^^^^'^tlfic 
information are adequate « 

C. A Chemistry Department libr^^^^^'^ 
information specialist would ^^^^ a 
useful function. 

D. Research done here is at the ^^^^^tont 
of knowledge In my field. 

E. Source materials (published ot unpublished 
literature) and reference bo^^® ^^^Hable 
to me are: 

a) generally adequate for needs 

b) too time-cons<mln^o lo^^^^ 

c) kept up to ddte 
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^n. An on-line searched bibliographic service allows scientists to^qulckly 
search the literature pertaining to a particular IniJorroatloft need. By 
typin g In Inde x ^jc ys on a Com puter terminal, a researcher can ohtaiyi 



a list of potentially relevant document citations within a matter of 
minutes ; t?^ / 



A. Have you ever used an on-line search system? Yes 



No 



B. If not, are you familiar with the functions of such a system? 
Yes No 

C. Would an on-line searched bibliographic service significantly Improve 
your current method 6f doing an information search?; 



Y^s Mo • Don't knov 



Please comment on the potential utility of -an on-line search system 
for your work and for the Florida State University Chemistry Department 
needs^ la general. *^ . 



18. Year of your birth: 19 

19. What is today's date xDn which you completed this questionnaire 

/ / 
mo. day year • - ^ 

20. If you have any comments about this questionnaire, or if you wish 
clarify any of your preceding responses, please do so below. 
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SURVEY OF THE INFORI^iATION STYLE OF MONSANTO SCIENTIFIC 
AND TECHNICAL PERSONNEL 

ti . ' • ■* 

On-li ne searched bibliographic siervices are nov^vflliable to a 

portion of the science and technology literature.* The individual 
researcher who has access to such service maj:^ilow ^tate his search 
requests as keyvords , and/or author names , and/or other access points 
that are keyed in at a computer terminal. Resxalts of such search 
requests, citations of potentially relevant documents, are printed out 
a;t the computer terminal in a matter of minutes when the number of 
potentially relevant documents is about twenty or less. Longer biblio- 
graphies are mailed promptly by System Development Corporation, the 
supplier of this service. • The rapid turn-around time makes reformulation 
of searches possible when initial search results are unsatisfactory. 
This service, and a list of 'available on-line searched bibliographic data, 
will be made available to you. * 

The potential benefits of such services of faster and more 
convenient searches are apparent, but a more basic question remains to 
be answered: what is "the effect of on-line searched bibliographic 
services on your information style—the way you seek and use information? 
Thi3 is basically the question that we will attempt to answer in the 
National Science Foundation-sponsored' study at Florida State University 
and ^tonsanto, 

. The project will 'be conducted in three phases: 

1. Collection of background information, present work roles, and 
, information style prior to tl^e introduction of on-line searched 

bibliographic systems, to be determined with the aid of this' 
questionnaire. ^ . 

2. Provision of. on-line searched bibliographic services and analysis 
of 'the extent? and types of use of this service. 

3. Assessment of information style after sustained availability of 
I on-line bibliographic search service, again with the aid of 

questionnaires and interviews . 

The immediate benefits for participation in the study are ^ee 
-literature searches. We hope to gain a better understanding of the effect 
of the use of on-line .bibliographic searched services, such that the ^ 
producers 5f bibliograj)hic data bases as well as the managers of information 
services may provide improved information services to you.. 

' We have a considerable amount of computer time to provide information 
service to you in the course of the study and have at the same time attempted' 
to keep your ^project connected efforts to a minimum. We hope that you will 
agree to participate in this study and will be able t^o provide the infor- 
mation requested below. You will not be individually identified in any 
reports which result from. this study, and your responses will be held in 
confidencie. .. Your individual code number is requested only in order that we 
may later fol-lowup for your assessment of the bibliographic service after 
"you have had the opportunity to familiarize yourself with it and employ it 
as may be appropriate in ^our work. 
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1. Your Monsanto survey code number: 

YQur_s^x;. Male Female- 



3. What is the highest oLevel of formal education. you have attained? 
(Circle appropriate letter.) ^ <^"cu. 

A. Less than college IP 

B. _ BA, BS (field of degree V 

C. MA, m (field of degree ' . 



) 



D. Doctorate Without dissertation (field of degree 



E. Ph.D. (field of degree 
,F. Other doctorate (field of degree 



G. Other (specify j 
h. Year in which highest degree obtained: if 

5. Calendar year. from which you have had continuous service (including 
leaves of absence) in a professional position at Monsanto: 19 

^' "^^^ yo^'p^ini^ Job designation in your present position at 
Monsanto? (Circle appropriate letter.) 

A. Bench cheMst 

^ B. Group leader 

C. Manager 

D. Scientist - 

E. Other (please specify: j 

. Describe the primary responsibilities and work in which yoU are 
Engaged. ^ 
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8, 



10 



Based on an average week, how many hours-, on the average, do yO^ ' 
actually spend in each of the following activities related to 
posi(tion at Monsanto, including time spent after regular workitJ^ , 
hour^. If applicable? (circ le o ne numbe iL_for _each_ lis±ed-actli 4^y ' ^ 



A. Administration 

B. . Work in a laboratory 

C. Writing or preparing 

research reports' 

D. Writing or preparing 

professional papers 

E. Locating information 

F. Reading professional 

lite rat lire 

¥ ■' 

G. Department or project 



meetings 



H, Informal .discussions with V 
colleagues - 



I. Other (specify: 
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ii^' :2;' ^ 'It. -is^f . .-^-^ (7 8 



1 . / 2* 
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Sinc.# Joining Mpnsan^;o how .ftapyUiihes^ he^ your official'' lob ii^le ' • ^• 

changed? f ; ■ ■ '■,Trv:i>" \ ' . / ' |,:^ 

Please list all offipial Job titles ,, dates , an({ emplgyWp /^pu haV«K<^.V/ 
in the past five years:' (jiist^Jiftost cnWnt -r^^st-^ • L'^f* 



Dates 



1,:-' 'itlst^J»bosi<cTiprent first"^ , 
'^Jofe' lltle - ' ' -A. 



work that you have, engaged in for a year or more 
. si^ce eam;Lng your highest degree (do not include part-time work 
, -while m graduate school). time worx 



^* rV-^^^^ or primary work you were engaged in immediately 

. prior to taking a job at Monsanto. uxa jr ^ 



... a. Teaching or administration in ah 
4.'v •• elementary, or secondary school. 

^ b. Full-time teaching in a college or 

university. 

> .X --^ ■ 

. V «, ?'uJ-l~time research in a college 

• 'or -university. 



and research in sa college 
',f.., _ 'pr university. 

>: ''Research and development in 

; , . .-^business or industiy. 

""^^ Res.earch and development in a . 

: governmental, agency. 

- - ■ .. . ... ■ ' 

^- Executive or administration 
^' position outside education. 

> *'h. ^OthWr professional position 
■'■ ■ : *:(spAcify: ' ). 



i Student . 

j .' Other (s^^ecify: 



All types 

of work 
(check all 
that apply) 



Primary work 
before joining 

Mbnsamto 
' (check one) 



). 
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12. Indicate how frequently you xased each of the sources on the list of 
sources of information during the last year. (If in the event your 
Job does not reqtaire the use of any of these information soxirces over 
the past ydar, check all Ns.) 



I H CO 

^ /^^ 

I S o C O -P 

^ O-H — mm — 0-to — •H— <U— — 



A. Your own collection of information, 

i.e., your personal files. N 



m H oSoe^oK 

S3 ocM o«H oe 

CO . O -P <M -p I 

o 'dO 'dLTNit^co'do 

a; (oH mf^ covo ma\ 

fe; :3 ^ 



B. Yoxu: own search through standard 
generally available indexes to the 

literatia-e, e.g.. Chemical Titles. N S 0 . ^ F 

C. Yoxu: own scanning vof standard 
generally available^abstract bulletins 



^ e.g.. Chemical Abstra^s , 



D. Yoxu: own scanning of in-house pre- 
pared Monsanto abstracts, e.g., 
Monsanto Content Previews. 

E. Yoiur own scanning of primary 
journals or other primary sources . 

F. Your own -browsing in the Monsanto »^ 
liliraxy. -.^^ ^ 

G. Your selection of a publication from 
a citation in another publication. ^ 

H. From a colleague on the same job , 






level at Monsanto. 


N 


S 


0 . 


• F 


R 


I. 


From a colleague or friend outside 
of Monsanto. 


N 


S 


0 


F 


R 


J. 


From your immediate supervisor. 

f. 

From another supervisor at Monsanto. 


N .' 


s 


0 


F 


R 


k. 


N 


s 


0 


ft . 

F 


R 



L. From a librarian, information 

specialist or another Monsanto ' 
. employee assigned to provide infor- 
mation, , 'N S 0 F R 

M. From a technician. N S O F R 

N. From an on--lino n^^^^ji^d bi'bliof.^aphic 

data base. l^pi' N 3 0 F R 

0. Other (Please specil5n:i||^ 2S h ^ ^ ° ^ ^ 
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13. Indicate how useful each of this sources on tAe list below was for 
meeting. the requirement of the *project(s) in whxch you were engaged 
during this past year. (In^€he event your job did natf require the 
use of any of the information sources, check 'all l*s-). 

. . ' ' . : H CM ^ ^ -=r 



■ ' ; ^ <U _ (1« -P to 

O ^ <U S ^ -P >H cj 
P _ "H >H :3 <U 

TJ -P tJ (U O O 

:) V -P <U S P< CO O 

1} ,4 « -H to o 6 a; >H 

A. Your own collection of information, 

i.e., your personal files. 12 3 k 

B. Your own search through standard 
generally available indexes to the 

\^iterature, e.g.. Chemical Titles. 1 2 3 h 

C. your own scanijing of standard 

{generally available abstract bulletins _ 
e^g. , Chemical Abstracts. 12 3 h 

D. Your own scanning of in-house pre- " 
pared Monsanto abstracts, e.g., 

Monsanto Contenii Previews . 1 2 3 ^ 

E. Your '.own scanning of primary 

■ journals or oth^r primary sources . 1 2 3 h 

. F. Your own browsing in the Monsanto 
■ library . 1 2 3 U 

G. Your selection of a publication from 

a citation in another publication. i 2 3 h 

H. FronI a colleague on the same job 

level at Monsanto. 1 2 3 li 

'f ' 

I. From a colleague or friend outside^ 

of Monsanto. .12 3 ^ 

J. From your immediate supervisor. 1 2 3 ^ . 

i ' K. From another supervisor at Monsanto. 12 3^. 

L. From a librarian, information ~ ^ 

specialist, or another Monsanto 
employee assigned to" provide 

information: 1 2 3 ^ 

M. From a technician. 1 2 3 2* ' 

N. From an on-line s.eapch^ bibliographic. 
O ; d*t&'base. ^ ^ 1 2^3 



\ 
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' Evaluate the utility . Of information sources in terms of your infonnatiori 
needs and preferences. (Indicate the importance you assign to each of 
the listed factors^) . . ~ 



tn 



S 

O 

s 

> 



p 

.1 



§ 

CO 



p 

§ 
t 

o 



A. 


Local availability. 


•E 


V 


s 


N 


B. 


Up-to-dateness. ' ' ■ 


E 


'v 


s 


K 


c. 


'Response time in obtaining 
citation/abstract. 


E 


V 


. s 


N 




• Response ti^j^ in obtaining full^. 
copy of original document. ^ 


E 


V 


s . ' 


N 


E." 


Accuracy /Authori tat i venes s 


E 


V 


s 


N 


F. 


Compreh^ns i venes s /Comple tenes s 


E 


V 


s 


N 


G. 


Direct us e^bility without ; 
librarian assistance. /"-^ / ^ 


E 


V ^'^ 


s 


N 


H. 


Other (please specify: / ^ ) 


E 


V 


s 


N 



2^4 



^ 



ERIC 
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For these aci^vities listed X)elow in Vhich you occasionally engaged, 
if only one information source could be used, which would you choose? 
{ Indi-cate-by-placi-n^ the-letter-stmding-f oi^ 

listed in question 12 and 13. Report an N/A if the activity is not 
applicable to your work in the past^year.) 

a. To keep up with new developments on a topic 

b. To find* out what is reported in the literature on a topic 

c. To brush up on a topic _. 



d. To look for specific facts related to on-going project ^ 

e. To look for -descriptions of ^procedures related to an on-going 
*- project . 



f . To prepare for a meeting within the .Company _. 

g. To prepare an internal reportV , 

h. To prepare a paper for external presentation or publication 

i. To prepare a patent application , 



j. To prepare a review of the literature . 

- ■ \ ■ 

If you were limited to the use of only three information sources of the 
list in questions 12 and 13, which ones -would/you choose? Mark answer 
by placing. the letter standing for^the information source that would 
be yovir first choice, your second choice j- yjour third choice, and your 
last choice . ' 

First choice: 



Second choice: ^ ' '.v''^''4 

\ ■ . " 

Third choice: . ' ' 



Last choice: 




7 
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17. ^Jhraluate the following possible changes in your work »set^^^ 

respect to their potential for improving your work as a scientist • 
Indicate your evaluation of whether more or less would be beneficial 
for each item. 



_ ^ ^ .„ 

lot 

w. p £ 2 5 WW 

CO B CO < CO ^CO H 

A. Supervision ' A B ' C D E 

B. Informal discussion with colleagues - A B C D 
Technical assistance a B C D -E ' 
Secretarial assistance a B C D E 

E. Laboratory facilities . A B G D E 

F. . Autoiony in i^y work ■ ^ ABC D E 

G. Access to published information A B C D E 

H. Access to in-house Monsanto reports A B C D E 

I. Structured time A B C D E 

J. Formal recognition for innovation 

or discoveiy , A B C D E 



K. Involvement in professional community A' B C D 
Role in organizational decision-making A B C D 



'^1 



E 
E 
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18". Indicate yoiir attitude concerninp:^ each of the following statements 
by circling one of the followinfr categories: Strongiyo agree (SA) 
Agree soniewhat (AS) , Disagree somewhat (DS), and Strongly disagree (SD) 



A. It is advantageous for a scient^a^ to perform 

his/her own Information search. SA AS DS SD 

,. ' ** - ■ • , ■ 

■ B. Present itieans of locating information in - ^ 

this organization are adequatie . SA AS DS ' SD 

C. The company librarian or information ' " ^/ 
specialist serves a useful function. " SA AS DS SD 

D. IRIsearch done here is at the forefront of . , ^ 
knowledge in field. SA AS DS SD 

E. The administration of this organization 

facilitates quality research. SA AS DS SD 

F. If I could retrace steps , i;. would 

choose another area of specialization. >SA ' AS DS SD ^ 

G. If I coiild retrace rr^y steps , I wotild ' 
choose a different kind of work setting. SA AS . DS SD • 

H. Professional scientists in research roles 
have too small a part In organizatioiial 

decision-making. . SA AS^DS SD 

I. Not enoygh '^opportunity- is given scientists 
in this organiza.tion for individual 

initiatijre in research. ■ ^ SA AS DS SD 

J. Lack of financial resources is the major 
. restraint on quality research in' this 
organization. " . SA AS DS SD 

^ ^ ., ■ ■ ^ . ■ ■ - 

K. Source materials Cpublished or unpublished • * " 

literature) and* reference books available ■ 
in this organization are: 

a) generally adequate for my needs .;; SA AS DS SD 

b) too time-consuming to locate SA AS DS SD 

c) kept up to date . - SA AS DS SD 



2$7 
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19. An on-J.lne searched bibliographic service allows scientists to quickOy 
^ search the literature pertaining* to a particiaar information need. 
^ typing in index terms on ^ coxnjjiiter terminal, a researcher can 
Obtain a list of potentially relevant"" document citations within a' 
matter of minutes. 

A. . .Have you ever used an on-line search system? Yes No ' 

B. If not, are you familiar wittrt^^ of such a system? 
"Yes^^ No J- ^ 

C. Would ah on-line searched bibliographic service significantly 
, improve your current method of doing an information search^ 



Yes 



No 



Don 't know 



Please comment on the potential utility of an on-line, search 
system for your work and for Monsanto needs in rreneral. 



20. Year of your birth: 19_ . » 

21. What, isH^oday's date on which you completed ^his questionnaire 

/ 0 

mo. day year 

22. At which Monsanto facility do you work? » 
Pensacola 



J)ther company /location 
(Please specify; 



) 



23. If you have any comments about this questionnaire, or if you wish to 
clarify any of your pre.ceding responses , please do so below. 
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April 26, 1977 



Dear Colleague: 



• \ • ^ 

Since May 1976 you h^ve been offered the opportunity to participate 
in a study of on-line search services. This study is sponsored by the 
National Science Foundation with the participation of the Florida State 
University Chemistry Department and Monsanto Textiles Company, 

We are now interested in learning whether the availability of the 
on-line search service' assisted you in selecting information for your 
professional tasks. The attached questionnaire is the post survey in- 
strument for this stage of the study. During the period of collecting 
responses to. this survey, we are suspending on-line search services , 
Subseqvient to this activity, we would plan to "again introduce the ser- 
vice and to. conduct selected interviews, contingent on NSF renewal of 
the project for another «year of funding. 

Whether or not you used the search service , please fill out the 
attached questionnaire and return it by May 10, 1977 to On-Line Search 
Project, Chemistry Research Building, Room 105, The questionnaire is 
coded only for follow-up purposes. All replies will^ be. treated confi- 
dentially; Frank, candid responses will be appreciated so that the ' 
ifesults of this study may assist in improving technical information 
service. • . ^ » 



We enjoy the opportunity to provide you with assistance when needed, 
and appreciate your cooperation in completing thfe questionnaire. 



Please call Gery Jahoda. (4-2242) or Al Bayer (4-6416) if you. have 
any questions about the study or the questionnaire. 



Sincerely, 




Al Bayer 
Sociology 




Gery Jahoda 
Library Science 
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SURVEY OF THE INFORMATION STYLE OF FLORI^^ STATE UNIVERSITY 'CHEMISTS 



Your F.S.U. User number: 



T 



Ba«*d on an average week, how .many hout^' the average, do you actually 
spsnd In each of the following activities "lated to your position at F.S.U. , 
Including time spent after regular worki*** hours, if applicable?/ (Circle 
one nuniber for each listed activity). , j 

AVER^GE^iiiME PER^WEEK 



ACTIVITIES 



..3£. 



ERIC 



A. Administration 

'v. 

Locating information 

C4 Readings professional 
literature, "rf 

D« Laboratory research, 
data analysis'^and 
computer processing 

Ei Writing or preparing 
research reports or 
professional papers 



ional or • 
ntal meetings 




G. Informal discussions wltlT''*^ 
colleagues ^ 

H. Te.aching (including preparation, 
lecturing and testing/grading) 

I. Advising and counseling students 
(including individual student *s 

committees) 

* ' ■ 

J. Attending class as a studefit 
and related studying activities 

K. Other (please specify) 
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00 
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• 


more 
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3. Indicate how frequently you used each' of the sources on the list of 
sources of Information during the last year. Please circle the 
appropriate response for each listed source. } 
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SOURCES 
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0) 




00 w 
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00 
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£3 
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A. Your ovm collection of Information, 
I.e., your personal files/ 

B. Your^ovm search through Indexes to 
: the literature, e.g.. Chemical Titles. 

C. Your ovm scanning of abstract bulletins 
or table of contents services, e.g., 

/ Chemical Abstracts, Current Contents. N S 0 F R 

^t). Your own scanning of primary journals 

or othet primary sources. * N S 0 F R 

E. Your own browsing In the FSU Strozler 

Library. N S 0 F R 

F. Your selection of a publication from 

a citation In another publication. ' N S 0 F R 

G. From a faculty member at FSU. N S ' 6 F R 

H. From a student at FSU. N S O F R 

I. From a colleague or frlenSvoutslde of FSU. N S 0 F R 
J. From a non-student : technlclarf/laboratory 

- asMstant. N S 0 F R 

f "^^1^^^^^ Strozler librarian. N S 0 F R 

' Ir. Ptjpfl)|^HS^^ services avail- 

ablj^^'in the Chemistry .Rese^rch^ Building. N S 0 F R 



-M. Trom^n-line 3earch^ ser^ce$^other than that 
avalj^le l^ jbhe Chemist ty Il^eafch Bldg. N 



N. 'Frqli a commercially codqpfiteir/^iBearched 
current awareness service j* eVg • » I.S.I. 
' jjpiachlne search current awareness*. N S 



0 F R 




Others (please specify) • ,n S 0 F R- 



2^1 



-4 
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4. Indicate how oseful each of the sources on the list below was for iiee ting 
the requirement of the project (s) In t^lch you were engaged during the 
p^t year. i?lease circle the appropriate response for each listed source. 



' 4 



SOURCES 



L. From an on-line searched bibliographic 
data base. 
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A. Your ovm collection of Information, ^ c=» S m *2 
I.e., your personal ^les. 

B. Your own search through Indexes to 
the literature, e.g.. Chemical Titles, 

C. Your own scanning of abstract bulletins 
^ or table of ^mtents services, e.g.. 

Chemical Abstracts, Current Contents .<> 1 2 3 4 

\ P 

D. Your own sc^nlng^of primary journals 
or other primary source4* 1 2 3 4 

E. Your^fbwn Browsing in the FSU Strozier 
Library. ^ .12 3 4 

F. Your selection of a publication from a ;^ 

t. citation in another publication. l'^ 2 3 4 

G. From a faculty member at FSU. 1 2 3 '4 

H. From a student at FSU. 12 3 4 

I. From a colleague or frienfl oulfcide of FSU. 1 2 3 4 

J. From a non-student technician/laboratory 

assistant. 12 3 

J 

K. From an FSU Strozier librarian. ' i 



4 

2 3 4 



M. From a commercially computer searched 
current awareness service, e.g., I.S.I. 

machine searched current awareness. ^1 2 "3 



N. Other (please specify) V : 1 

% ■ — 



4 

2 3 4 



^6 
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Evaluate the utility of Information sources In terms of ^our Information 
needs and preferences. (Indicate the Importance you assign to each of 

the listed factors). "~ 

••; • . ■ V> . 

^iM'M <d S a 

Pit^ u u u 

- o o n 



A. Local availability. ^ 

B. Up-to-dateness. 

C. Response time In obtaining 
cltatlon^^bstract . 

*D. Response time In obtaining full 
copy of original document. 

E. Accuracy /Authorltatlveness 

F*. Comprehdnslveness/Completeness 

G. Direct usability without 
librarian assistance. 

H. Other (please specify) 
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V 


s 


N 




V 


s 


N 


E 


V 


s 


N 


E 


V 


s 


N 


E 


V 


s 


N 


E 


V 


s 


N 


E 


V 


s 


N 


E ' 


V 


s 


N 



Ii2lj?^a 5^%°°-^^"^ ««"<^h service Wv^iabie in the^'dhiiistry Vcseii^ 
olilaing In terms of vour ^rlf«^«.«w«« -j^ -/ .^, ^»cMu.atry nese^^ 




>• 
I 



I 



A. Coverage of the literature \ o ^ * ' o 

(journals, patents, reports, ank o i ^ ; j ^ 

other source material indexed in\ >, ^ • ' \ ^ m 

the bibliographic data base) ^ § « ' § 

1. Subject included VG G F P 

2, Specific journal titles, patents, 
reports, and other ^publications 

included VG G F P ^ 

3. Up-to-dateness of literature 

included VG G F P 

4, Adequacy for retrospective 
searching (going back far 

, enough in time) . VG G F p « VP 

B. Interaction with system 

1. Search service hours in 
Chemistry Research Building 

^' • VG G F ' P ^ 

2. Performance of searches by 

information specialists VG ' . G F P ^ 

3. * Information provided about the 

on-line search system VG G F P 

4. Subject access, i.e.., keywords, 

subject headings, descriptors VG G"* F ^r/P ^ 

5. Other access points, e.j?», author, 

work location, language, year VG G F p 

• ' ■ 

6. Ease of use ' . VG G F P V? 

Search results 

1. Lapsed tirae^^or obtaining 

search results on-line VG G '^ F P 

2, Lap^d time for obtaining 

search results off-line VG G F P 

f3,^ Completeness of search results VG G F P V*' 
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4. Exclusion of non-relevant 
citations VG 

5. Availab±M.ty of full text of" 
relevant citations In personal 
collections of journals » reprints, 

. 'etc. * . ^VG 

6. ] Availability of full text of 

relevant citations in' Strozier 
Library VG 

?• Availability of full text of 
relevant citations via inter- 
library loan VG 



VP 



VP 



VP 



VP 



7. • For those activities listed below Indicate your opinion of the utility of 
on--llne searches. Please answer even if you have not used on-line services. 
(P^ase circle the ino3t appropriate response for each activity). 



c. 



- ; > 

Utility of on-line 
bibliographic services: 

To keep up with new 
development's on a topic 

To find bo^what is reported in 
the literature on a topic « 

Jo brush up on a topic 



d. To look for specific facts 
related to on-going project 

To 'look for descriptions of 
procedures related to an 
on-going project 

r. Tcv prepare tor teaching 

g* To prepare grant proposals 
. ,or grant reports 

h. To prepare a papjsr for external 
presentation or publication 

i. To prepare a patent application/dis- 
closure 
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^° prepare a review of the literature 
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Indicate your attitude conci^rning each of the following statements by 
circling one of the following categories: Strongly agree (SA) , Agree 
somewhat (AS) , Disagree somewhat (DS) , and Strongly disagree (SD) . 

A; My present means of locating scientific 

InformaHon are adequate. SA AS ' DS SD 

B. A ^ChemlsjKry Department librarian or 
Inforwclon specialist would serve a 

useful function. SA AS DS SD 

C. It Is advantageous for a scientist to 

perform his/her own Information search. ^^^^ AS DS - SD 

D. Finding citations without , using an on-line ' / 

search service Is easy compared to lo- . . 'A' 

eating the full text of the document. SA AS D$- ' /:si)" 

* 

E. Finding citations by using an on-line 
search service Is easy compared to 

locating thji full text of the document./ SA ^ AS DS SD 
I prefer to delegate literature 

searches tp §pmepne else. SA AS DS SD 

On-line searches allow ohe to spend 

more time reaidlng the' lilterature. SA AS ' DS SD 

H. On-line searches allow one to spend 

less time In- searching the literature. SA AS DS SD 

I. If one relies oji only on-line searches » 

Important pltatlons would be missed. SA AS DS SD 

J. I prefer to delegate formulation of 

search strategies for on-line searches 

to someone else. SA AS DS SD 

K. The results of an on-14.ne^earch should 
be double checked manually against the 
, corresponding^ printed Indexes. SA AS DS SD 




L. On-line searches Enable on^ to Increase 

scholarly productivity^ ^ SA AS' DS SD 

M. On-line searches are too time consuming. SA AS DS SD 

N. On-line searches retrieve too many 

useless artlcle^^ In foreign languages. SA AS DS SD, 

0. I prefer to do my own on-line searching 
Including "hands-on'* use of the compu- 
ter .terminal myself - > - , SA AS DS SD 

f..-- . , . " . * 

•*'•*■. 



A search on CHEMCON (CA Condensates. 
on-line) costs $1.65 per miniite; the 
average search takes 10-15 minutes 
or approximately $20.00. 

1. Chemistry Department funds should be 
made iavailable fo^^-line searches. 

2. I would be willing to ask for fmids 
in a grant <Jr contract proposal^ 
cover on-line search services^ 

3. I would be willing to pay out of 
pocket for on-line searches. \ 



SA AS DS SD 

SA AS DS SD 
SA AS DS SD 



'^IndicSte how many of each of the following activities you have per- 
formed in the last 12 months (if none, mark zero). 

Itw^lcate the number of these for which literature searches were per- 
fi^rmed in the last 12 months (if non^, mark zero). 

^1 



Indicate how. many of each these were searched via 
ing in the lAst 12 months (if none, mark zero). 



-line search- 



A. Preparation of manuscripts , 
' papers, or rieports for 

meetings or publication 
(include dissertation^ if 
applicable) 

B. Preparaltion of grant or 
contract proposals 

C. Prejyrfation of new courses 
ot modification of old 
courses 

D. Preparation of other tech- 
nical papers or reports not 
for publication 

E. Other activities requiring 
literature searches (Please 
specify) * 



1 

how 
many? 





hbw'^many of I 
required liter- 
ature searches? 



xxxx 



III 

how many 
of II used 
on-line 
searclies? 

■ 
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Please comment on the advantages of on-line search services f o^^your 
work and for the Florida State University Chemistry Department needs 
in general' 



Pleife coimnent on the disadvantages of on-line search services fpr 
your work and for the Florida State University Chemistry Dep^#foe>t 
needs in general. ^ ^ J 



What is today's date on which you completed this questionnaire? 

/ / . - 

mo. day year " 



If you have any comments about this questionnaire, or if you wish to 
clarify an^ of your preceding responses, please do so below. • 



02; 
v» ■ 

f' "v 



V 



J 
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SURVEY OF THE INFORMATIOK STYLE 
OF MONSANTO SCIENTIFIC AND TECHNICAL PERSONNEL 

Your Monsanto survey cpde number: 



Based on an average week, how many hours, on the average, do you 
actually spend in each of the following activities related to your 
position at Monsanto, including time spent after regular working 
hours, if applicable? (Circle one number for each listed activity.) 



Activities 



A. Administration 

B. Work in a laboratory 

Ci Writing or preparing 
research repolrts 

D. rewriting or preparing 

tfprof essional papers 

E. Locating information 

F. Reading professional 

literature 

G. Department or project 

meetings 

H. .Informal discussions with 

colleagues 

I. Other (Please specify),- 
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Indicate how frequeil€iy yoti used each of th^ sdurces on the list of 
sources of Information during the }ast year^ (If In the event your 
job did not require the use of any of these Information sources over 
the past year, circle all N'a.) 



CO 



Sources 



A. Your own collection of Information, 
I.e., your personal files. 

B. Your^ own search through standard, 
generally available Indexes to the 
literature, e.g.. Chemical Titles.* 

C. Your own scanning of standard, 
generally available abstract bulletins 
e.g. . Chemical 'Abstracts. 

D. Your own scanning of In-house pr^- 
pared Monsanto abstracts, e.g., :^ 
Monsanto Content Previews. 

Your own scanning of primary 
journals or other primary sources. . 

F. Your own browsing In the Monsanto 
^ library. 

G. Your selection of a publication from 
a citation lii another publication. 
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0 


1 

F 


R 



N 



N 



N 



N 



N 



H. From a colleague on the same job 

level at Monsanto. N 

!• From a colleague or friend outside 
of Monsanto r ^ 

J. From your Immediate supervisor. 

K. Fr^jtfanother supervisor at Monsanto. 

L. From a librarian. Information . 
specialist, or another Monsanto 
employee assigned to provide Infor- 
mation. . \ N 

M. From a technician. N 




S 
S 



0 
0 
0 



0 
0 



F 
F 
F 



F 
F 



R 
R 
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CO 



Continued. 

V- ' . . ' 

N. From the NSF-sponsored (fr^e) 
on-line 8ervj|pes available at 
. Monsanto. 

0. From on-line search services other 
than what is available through the 
NSF-sponsored study (i.e., charged 
to your cost center). 

* 

P. Other (Please specify) ^_ ^ 



0) 

m 

M 



N 



N 



00 

CO 

o 

"CD 



•3° 
o 

•H ^ 

OO 09 

O 4J 

00 fO 



* 9 OD 

•O 00 

CO 



0) 4J 

o 
u 



u 

O 



00 OH 



R 



R 



N 




1 
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Indicate how useful each of the sgurces on th^ list below was for 
meeting the requirement of the project (s) In which you were engaged 
during the past year. <Iri the event your job did not require the 
use of ariy of the Information sources, circle, all l-'s.) . 

Source s n 2 -i S 2J *S H 

. „ 2^ w « o e 0) 

A. Xour own collection of Information, ^ ^ ^ * »^ *^ 
I.e., your personal files. 1 2 3 4 

■ • ■ . y 

B. Your own search through standard, 
generally available Indexes to the 

, lHlirature, e.g. , Chemical Titles. ^ 1 2 3 4 

C. < Your o«nHk|ilng of standard, 
« Seneral9|^H.lable abstract bulletins 

e.g., Chral^l Abstracts. 1 9 ' 



0. Other (Please specify) ^ 1 £ 3 




D . Your own scanning of^ln-house pre- 
pared Monsanto abstracts, e.g..., * * 
Monsanto Content Previews. 1 2 3 

E. . ..Your own scanning of primary L , 

journals or other primary sources7\ 1 2 3 

F. Your own browsing In the Monsanto ^. 
library. 1^ 2 3 

G. Your selection of a publication from 
a citation In another publication. ^1 2 3 

H. From a colleague on the same job 

' level at Monsanto. ' 1 2 ^ 3''- A 

I. From a colleague or friend outside 

of Monsanto. , 1 2,3 4 

J. Frc^your Immediate supervisor. 1 2 3 

K. From another supervisor at Monsanto. 1 2 3 4 

L. Froli a librarian, Infoinnation 

specialist, or another Mortsantfb emp 

assigned to provide information. / { 1 2 3 4 

M. From ,a "technician. , 1 2 • 3 \ 4 

: N*. Ftoin an on-line sisarched ■bibllographi 

data. ba3e.' ; ^ ' ^ / 1 2 3 4 



4 



4 



5. Evaluate the utility of Information sources tn terms of your lnf(^miat Ion 
needs and preferences. (Indicate the Importance you*assi^ to each of 



the: Ilste^ f actors . ) 



■ A * ■ <i> 

at ' u " 

V » ■ , >-i u u . 

, 1 ■ W Ou 0« O 
-H 6 0 , • CX 

• , ■'v<- M M ■ . ,r4.B. 

% ' C3 • ■ 

/ 0) >% - o ^ . 

CO U 0 4J 



^ . . • CD o o . d 



A. Local availability.^ ■ ^ E V ^^S 

■ ' •. . ♦ ' ■ * ' ' . • * ■ • J 

B. Up-to-dateness. ^ Ei ' ' . V S ; N 



C. 






cltatlon/abs tract. 


E- 


^ V 


s 


N 


p. 


Response time in obtaining full'-'A^ 
copy of origlaal document. . 




V 




N. 


E.r 


Accuracy/Authorltatlveness 


E _ 


•V 




N 


F. 


Comprehensiveness /Completene*ss ^ 




V 




N 


g: 


Dlrec^ usability without 
"librarian Cassis tauce . 


■ » 

E 


V 






H. 


Other (please specify) 
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_6^_^saliiate^4Jie-4lSE=-^ponsored-on-line--8earc^^ 



^ charged to- another budget) available at Mo^rsntio in terna o£ ;you^^ 
y matlon needa whether or not you have used thla, service/ (tndlijate your 
J.. pplnlon concerning the adequacy of each^^of |the aiste^^^^ 



• ^^Coverage of the literature 
♦ ^ (Journals^ patents, reports, arid)' ' 
other source^material Indexed Iti^ 
. the Wbliographlc data base) 

' 1. Subjects Included 



O 
I 



I - 



> 



2" Specific journal titles^ patents,'' 

reports, and pther publications . . » 




Included 



VP 



3._' Up-to-dateness j-of literature » / t'U' -l/^^^/^^^^^^^^^ ' . ' \ 

.4. Ade'«|oajcy for' ret;roapte<;:tlve .-va /! • -''"-i^ ''■'■^'-i^--- ^^^^^^^ 

••V"?«arehlM (going' baeik far - : ' : ^ V 
6ilp»#i J(n- .|tline) » ,•„ j^' VG^^^^ ^ ' ; 



.- •V • 



B". Interact ignCwlth .system 

V* ^ 1,, Search>/erv%:ej hpu^s.-^^^^^ ■ 
Monsanto . : . ? 




^.-^'^ . Performance searches by ^ i*. 

llbjraVy Inforinatlpn specialists . 

3. - Information .prbviSSed about the * 

on-Une; search system ^ • 

^ ... . ' * ' ' ■ ■ • " 

4 . .SubJ ec t; acdess , i 1 e . ^ keywords , 
/ subject headings, descraiptors 

*5 i Othef acce^ points , e . g . , author, 
work location, languajgei year" 

6. Ease' of use 



VG 

VG 

VG 

VG 
VG 



G 
G 



F 
F 



P 
P 



VP 



VP 
VP 
VP 
VP 

VP 



C. Sear-ch results 



1. Lapsjgd tlpae for obtaining 
search results on-line 

2. Lapsed time f or >obtalnlng 
sear^fii rersults off»-line 



VG 



VG 



VP 



VP 
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3. Completfness <^s.^eajxh7t'€|$^lts 



4, Exclusion of ribi^-rSleyant 



citations 



VG 



VG ' G 



VP 



VP 



5. Av^lablllty bf flill text o^ V V 
relevant citations In personaj^^^"' 
collections of jouVnals, reprfntS^^c^^vr; 



etc. 



6. Availability bf full text of 
relevant 'cl^atlorts at thisi?? 
Monsanto facility. 

7. Availability of full text of ' 
relevaht citations via inter-' 
library loin 



VG 



,VG 




4?^ ■ 'V 



%F<-.. \ P 



P 



VP 



VP 



7. Por those activities listed bedow indicate your opinioa^fr the utility qf 
on-line searches. Please ansW^en if you hdv^ not. used oa-llne services. 



/ 



is 



Utility of on-line' ^ 
bibliographic services ; 



a. To keep up with new 

developments on a topic 

find out what is reported in 
, the literature on a topic 



.0 CO 



•00 CO 



C. 

d. 
e. 



To bruah'up^ on a 



topic 



B 



.7> 



V 



TO 

5 •=» 

a (u 

O GO 



3 

oo 

J? 




To look for specific *facts 
related, to on-golpg project 

To lookyfpr'^descrlptioas of 
procedures related to^n 
on-going project^ T . . 

To prepare fpr a meeting 
with'to the company y^^^^ 

't ■ 

To prepare anilntemal report 




B 

B 
B 



V' 



p. To prepare a paper for external 
presentation or publication 

1, Ti>, prepare a patent appll'catlon/dis- 
closure . " 



N 



N 
N 

N 

N 

N 
N 



O J> To prepare a- review* o^' th^ 
ERIC, \ literatures 



•2?5 



B 



N 
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-A? Indicate ;pur a%t±tude^(msieTnirig parb^of-the follovlng-atatements-^ 

clrcling-^e-ofHtJhe folloWng categories: Stfongly agree (SA) , Agree 
somewhat (AS) , Disagree soniewhat (DS) , and^tfongly disagree (SD). 



A* M7 present means of locating information 



In this organization are adequate. SA AS DS SD 



SA AS DS SD 



B. A company librarian or information 

specialist serves, a useful function, SA AS DS SD 

€• I^is advantagegp for a scientist to 
perform his/hdr Swn irifoinnatlpn seai-«h. 

« 

:D. .Finding citations without using an on- 
line search service is easy compared to 

locating the full text of the document. SA AS DS SD 

k Finding citations by using an on-line 

^ search service Is easy compared to 

locating the text of the document. SA AS DS SD 

F. I prefer to delegate literature . * 

searches^ to someone else/ SA AS DS SD 

■ • ^- , . 

G. On-line searches allQ<i.on^ to spend 

a|||re 'tlme reading the'' literature. SA DS ' SD 

^^ H. On-line sgyarcWfes allov^ one to spend *^ 

less tl^ in searching the literature. - 5A AS DS ' SD 



^* ^^^^^ relies on only on-line searei&s, ' ^ \ ^ 

5^ortant citations would be missed. SA AS DS SD 

J. I prefer to delegate formulation g^f V 
search strategies^or on-line searches. 

to someone else. , SA AS DS SD 

results o|^^^n;^^^ 

b^ double che^ff ipani^l^y ag^^^ th^ . • 'X^-^-' 

' ^^l^sP°^d^^8 'Pridte^^ \ SA \ AS DS^?^ 

L. On;3Line'-. searches enable qne t6 increase 
^ scholai^ly productivity. • SA AS 

^•^^^•lii*^ sear^ches are too time corisumlng. SA / AS 

N. On-line searciik^ retrieve too many ^ 
^^^^^^^ articles, in foreign languages SA AS 

^0. prefer to do my ovnijrpnjfllne. searchi^^^^ 

. Including /'hands-onlV usefcf compji^t«¥ • - 
terMi»al ^s^lfy I ,t ^ijj^A AS DS . SD 

:>vv; . /C- ■^:■:t*■^:■>■■ 
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P. A search on CHEMCGN/ (CA Condensates 
on-line) costs $1.6§rper mlnurterfthe 
average seafch takes< 10-15 minutes 
I or apprpxlm^teiy 9^^^^^ 





1. 


Cdmpahy fuilds 9,^puld be biidgetedT' 
to the llbrii^y'^fpr on-line * 
searches . ' / . ' 


SA 


• 

AS 


DS 




"2. 


My cost center ^IVould be willing 
to pay for on-line searches. 


SA 


AS 


DS 



SD 



SD 



I." ^Ipd|fca^^ activities you have per- 

^ fo^^ed ^^^ ^^ ^^ ^ 0^^^^^^^ (if none ^vTp^rk zero) . ' 

m Ind: these fpt whlc^^^ searches v/ere per- 

| i l2 nu3iht!h»> Htlf riot^^ \marK raro)« ■ 

e^^^v^K^these-were searched via on-line search- 



*^ ,\An(gl In jlje \a^i V2J^Qv^^ =iA^ hone, inafk zero). 



IT 

how many of I* 
Required liter- 
ature searches ? 



III 

^ho^ many 
of II used 
on-line 
searches ? 




Xt. Please cononent on the disadvantages 'of on-line search services for 
your work and for Monsanto needs In general. 



12. What is today '^-pate on which you completed this^qiiestionnaire? 

^ ■ / '/ _ 



V 



mo; 



day y6ar 



.4 ■' 



If 'jiou h^ve any comments abbut this questionnaire , or if you wfsh to 
Clarify any of your preceding responses, please do; so Below. - 



.0 



Please return this to: 



'Paul W. Gann, Libraryii Systems 
MonVanto. Tex-tiles Company, 
^P;0. Box 12830 

j^^^sScola , -s'Florida 32575 ' 



:S^e>^ched by 

Data searched 
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'<^^ ' .PSU search ' 



INFORMATION SPECIALIST'S RECORD OF ON-LINE USE 



"'^tV"' ■ '-. • ■ — ^ 

\/ PRE-SEARCS 

1. Search request received: ♦ ^ > 

[ ]in writing" [. ]in person . [ ] by phone 

[ . ]by other than final xjser t ^ ■■ ' 

•#■ 

2. Relationship to previous searches: 

[ ]n*ew searcR , 
[ Icontiauation/update* of previous search 
\ [ ]modif ic^rti^on of previous search 

3; Initial ^eaij^^ r^eque«t 

( ]synonynis supplied by 
[ ] logic -supplied by user" 
cons trainjts supplied by user: 
■ [ ] English language only* 
[ Jauthor (personal) 
[ ] types of publications (specify 



) 

user X 



) 



r ] maximum // of citations, wanted (specify: 
r I ]tiipe period to search (spjfecify: 



PrepafT^^g reports or for'meeting or publi- -4^ 
cation: ' . ' 

;[ lintemal meeting [ JinternJ^l report 
[ ]patent application 
[ Jpublication^*^aper for.y^ternal 
dfsseminattonX 



6. 



[ Jother (specify: 

Sources^mployed^^"^^ searching this 

tppi^prior to seeking this^Zm-^lne search: 
r Jmanual self -search' of printed^ itMlexes 
I ]self-se§r:€h of on-line system a^s (SDC 

microfiche, etc) 
I ]self search in researcher 's,. journals , 

reprints & other, personal collections 
i;^j^f^] discuss with colleague ' 
'^^V:Jother (specify: ^ / ) 



7. .N&^pti^^^n fcijne (pre-termilll) in min^ 



f ]other restrictions %pe^ 




Primary applications , ■ ' 
,[ ] teaching ! / / ' ['" ]re,^^!^^;^-^fr 
[ ]other |(speq:tfy; ■ . • ^ 



) 



. User's types of approaches and purpose;p$li;^^^^^ 
thi^search: '"^^i^;^^-'^''"''^^' 

' Mm 



':^Y?E§ 0£APPROACI»t 

[ ] current awar'.eness 



f ] exhaustive'^ 



[ ]a few references on { jbrowsing 

topic ^ - 

[ Jspecific facts or procedures' 

PURPOSE OF US'fc: ' / ^ , 

Kee'ping current 'On: * - ^. 

[ Jdevelopments in owti ^^as.qf competence 

\ f Jdevelopments *in related areas 

•Developing competence by: 

I Jbrushing ^jwp (rel^^ning) 
. [ 1 learning new speQialty -m. • j ' 

Swplpor ting worlc,^e|-Sted to pn-goin#proj ect : 
. [ Itileory^; ] facta ' 

Q Iproceddres/'-Jappar^Ltib or meffiiodoiaey 



i ICHEMCON • r1^E^!7p7l [ JCOMPENDEX 



' .l-.flother (spercifyrT'kr^- . 



/' Number of^^ns^arch statements 



id. Unique citations' printed on-line 

11. Citatioiis^rinted off-line: 

12. Connect time in minutes;. 



i K 



13. time </ith user (post-learch) in min. 

14. ^ User present during entire search: 



[Jno 



search?^ f ]no Jyes^ 



telephone [. ]in person^ f 



15. Did use^^^ifiteraction''/^ place ^ring the 



16 . Did t 



search r 



l/problems delay the on-line^ 
Jno : yes, was it: 1| 
f ] log-on problem [ JTYMSHARE p«blems 
[ Jother (specify; ) 



17. What funds areSpaying for this search? 
• [' ]User's ovm^grant 
r ]Major* professor 's grant 
[ jD^partmentaJ^ funds % 
jofiier (specify: ' • 



Searched bjr 

Date seairched 
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WrC uscr# 
MTC search* 



,^INFORM|riON SPECIALIST'S RECORD OF ON-LINE USE ' 



i PRE-SEARCH 



Search request recieived: 

□ in writing Cllin person Oby ihbne 
□by otjier than final user ' 

Relationship to previous searches: 
□new search 



Preparing reports or for meeting or publica 

□ internal meeting - pi internal report 
j| □patent application j 

"□publication^ or ^aper for external 
dissemination 

□other .(specify; 



□ continuation/update of previous search I s c;n,t^!^oo j 

□ modification of previous search. I 5 • Sources employed searching this : 



3* Initial search request: 

□ synonyms supplied by user 

□ logic supplied by user 

icop^trs^nts supplied by user: 

□ Engidsh language only 

□ authw (personal) 
n types jof publications (specify: 



topic prior to seeking this on-line search: i 
□manual self-search of printed indexesT^ 

□ self-search of on-line system aids '(SDO 
micr^lche, etc.) /y:^; 1 

□ self -search in researcher's j1>utTials, ' 

reprints and other personal collectlbq, 

□ discuss, with colleague|^ 
!□ internal company report' 



□ other (specify: 



* ) 



□m^xiAum ?/ of 'citations ^anted||(speclf y^.' 



□ time period to search (specify 



□ other restrictions (specify 




Fll'es seax^ed; 



C□"GHEMCO^t^ □CHEM7.071 QCOMgENfEX'- 



-Q^ther Cspeclf y : 



— — — ~ — 

. User's types of approaches %id purposesi^'V 
for this se£ird|^&^ ; . ' ^ . 

. TYPESii OF APPROACH: . -* 

r □current awareness □exhaustive 

□ a few references on topic 
% □ browsing □ specific facts : 

^ or procedures 



7, Number of s 



of search , statements; 



PURPOSE OF USE: : 
Keeping i€tirrent on: 
QJ developments in own areas of competence 

□ developments in related areas »v 

Developing competence .by: 
□brushing up (relearning) 

□ ifearnirtg i\ew specialty 

Supporifting work related, to on-going project: 
P theory .. .□facts 

□ procedures, apparatus or methodology 



8. Number:^^£itiue .Citations printed 
10. Conndfc tl^e in minu te4 ^-^:i^- ■ " " ; 



11. User preser»t ^^4uting entire search : ' 

□ no; yes^by □ telephone C-Jin persaii; 

^^* tP^^ user interact ijon take plaie;(e during the 
■ Se^arch? ■ ' ' ."^ • 



□ no 



□ yes. 



13. Did technical problems delay Jtie on-line 
^ search? ^ - ^ * ^ 

□ no; yes, was it Qlog-on problem; ' 
^ 23TYMSHARE problemb • : " 
^••dpother (specify: > ^ ' • 



9 



»■ 



i 
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FSU User 



FSU Search No. 



USER'S REACTION tO 0N-1>rNE' SEARCH 



We -would appreiciate your help in evaluating the ajftachecfcomputer^ 
search results. . Whe'n you have had an -opportunity to mview^the citas .-.'^^ . 
tions (off-line and on-line^, please answer^ the quej|l^™^ 



Fold, staple and mail thje completed questtonnaife viav campus mail i 
to On-line Sea/ch Project , Chemistry Research ^ui Id irtg (Unft 1), Rm. 10.^. 



.1. 



The number o£ citations retrieved by this search was 

a. Of these citations approxdG&'^^^gflJiow ma'py.were familiar to you 
prior to this search and potentially relevant to the search 
topic? ' ' ■ . \ ^ 

b. Of these ci^ations^ approximately how many wereiptew references 
^ tb^.you (p^viidfUsly unfamiH^ the 

search toylc? \ 

c. Approximately how many other citations were familiar to you 
and relevant to the search topic but not retrieved by this ' 
search? ■•' • . - \ ^ / 

AMjppximately how many citations #ijprieved by this search 'do 
y2Kj pian to investigate further? __________ 

2- ~~}^s^t is yoiir opinion on the number of citations retrieved? ' 

[ ] Just about the * [ ] too mgny citations ' [ ] not enough 
right number citations 

^ 3. WJi«t rjts., ypur opinion of the currency (up-to-daten^i^s) of the search* 

^;.^-^pults?V...... ^ I :^ . : 

Satisfactory [. ] Sai^if actory [ ] Unsatisfactory 
""^^ 'LI Highly Unsatisfactory' [ ] Does not Apply 

4. What is your opinion on th^jgutility of i^e search results for your 

' intended purposdf^ 

[ J Very Useful L| Of Some Use [ ] Of * Marginal ^.U till ty 
^ [ ] Of No Use 

5. Any kdc^itional comments you have regarding this search raiay^ be/ listed 

^ here (attach "iiny additional sheets if desired). 



E 



R&tnn: T Pa ul W -n^: 



"technical Libi/i.y, MTC 
Pensacola, Florida 32575 



MTC'scarch#, 



• USER'S R||pTION TO ON-LINE SEARCH ^ 

\ .■ ■ ■'• . '■■ . ". 

IHte^ould appreciate your help in evaluating the attached computer search results . When 
yoUrJave had an opportunity to review the citations {off-line andon-lme), please answer 
'the questions below . « ? 

L The number of citations retrieved by this search vyaf y^^^^ '^i^ ' > *^ 



a . App^imately how many citations were-familar to you prior to this search 
andlpot^ntiatly relevant to the search topic ? - . 

' J!'- - ' ■ ^ , ' . ■ 

b. ApproDtimately how many citations vlfere nei/references- to you (previously unfamilar) 
and potentially relevant to thfe search topic ? 

c. ApprcwimaTely how many citations were familar to yoj^and. relevant to the search 
topic and not retrieved by this search ? . ' 

' f • 

d. Approximately how many citations retrieved by. this search do you plan to 
iiWestigate^ further ? ^ . .^j.^^; , . , 



o|||ai 



2. What is your'^pihion on the number of citations retrieved ? 

^ 1 



Qjust iabout the 
right nujribef 



□too many citations Dnot enpugh citations 



^ .3. V/lMt is your opinion of tNc^urrency (up-tp-dateness) of the search rerults ? 



/-. r^very, satisfactory 



[^satisfactory 



Qunsatisfa?!ory , *Dhighly ur.:..tisfactor 



i 4. wVr.jit f^'^ur c,,;nion i:f th- 'utility of the sear^||je^lts for your intc^ided purpose ? » 
r^vsry usef .: Dof some ms# Oof marginal Mtiiit^^ . n 



5. Any additional comfnents you have regarding this -search may be listed here (attach any 
. additionft sf^^'L^t^-if desired) . „ 
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GUIDELINES FOR' FSU'S INFORMA ljlON SPECIALIST 'S 
RECORD OF ON--LINE USE 



The following discussion and. deflhltiqp^^y be helpful in complet- 
ing the Information Specialist's Record oif On-Line l4e form. It- is 
suggested that the user information, search number, -''Searched byi," 
. "Date searched," and "Pre-Search" section be completed prior to the 
. on-line search and that the "Post-Search" section be completed immediater 

ly following. the terminal search, while the print-out is stiLl avail- 

*^ s» ' ■ V ■ 

-^^^^v'^:^^^^ t.opic requires an Information Specialist's 

form and a UsBt' S' Reaction form. If ypu are not ^ure i-t is a separate. 

- " search topic, ask the user. " 



PretySearch Questions . ^ """^ 

1.. /'Search ffequest deceived": check all that apply. The phrase' 



/'in writing^ refers to formal correspondence, as well as a few keywords ^ ' - 

jotted dbwTt on ;v^xap . paper. The phrase "other than final user" refers to • ^ 
/ request^ rec^ifed ^ a 'tHi^^^^ ... 
--- be given to and^^^::vby ^^lAl'^Sml^^ Bill Smith will, complete the^UserJs' 
\ y^^^^actipjy to On-Line Search form. If the request is 'received in wrlMng. ' - ' 

^"^^^ to the., back of the Inf^nnation Specialislt's^ form. ' . ^. , ^ ,j|f.^~ 

2. "Relationship to previous searches": dhe'ck.one categorv only. 
A "new-search" - Should^ be co'anted .tor each new topic that is not k . . 

modification" or "continuation" of ' any previously conducted search-^ It 
Is conceivable^ that mb^^ will 'be;receiveci and conducted |p 

at; one- ter^y^nal^^siort for more than one user;,,^3ilf you are%bt certain 
V ^new sear ch'''^riJr the user pres^^sk the user. , a ^ * 

v v' . a "continua.i^|i/u previous search'''- are: " \ 

B«,l^:^:::r^^^ on a-dif i^rent data -base^-^^^ the search 

rr.cr::::J?r.; CHEMCON, the user th6n returns and requests 

ERIC ••■■..^ . . ' :^mMil; -C,.. ; ... _ ■ 
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the user_thetLjretimjLand^^^ . | ; 

CHEM7071; (b) a sea^h Is perfpnned on CH£l«:pNr>n<^i^fc^^^ 
■ returns and requests that the sajne^earch ■^b^,,doii^':fc|iS^^ 

on CHEMCON. l.e., SDI service (selectfve dlsseminai^^&'i^,J^^lon) V'^ " 



A "moaif lcatl9^;,of jn-evious search" occurs wheu a tiew search strateg^- 

, is adopted, additionaJL;;|^^i:ds^ ^ployed/ otl^rl^devlces are used ' ' \ 

'to ch^ge the, approach^ jthe topi previously searched. If ' 

you cross data bases during- the same ternlnair session, count as one search 

(use one Information Specialist's form and one User's Reaction form) 

« unless a1||fferent topic is searched. When, crossing data b^es, a scertain' 

amount of vocabulary change is necessary; however, count as a^i'caSttCiuuatibn^ 

of previous search" unless based upon previous print-outs and/or liser, 

_1^^5Hi&'5iW?M?0^^ that it must be counted 

a^ a "modification." » ' 

3. V'Init;Lal search request": dheck all that apply'f An "initial 
jearch request" refers to the search requests, it is presented :to the 
information specialist by the user bef orl^Bj^otiation takes jlace. . . 

- The: word , "synonym" should be t ^d iiTits broadest sense, e J. , NMR . 
or nuclear magnetic resonance; transitioii^nietai,. organometalli"^7 or " ^ - 
manganese would be considered synonymsl" ' should be emphasized that| 
this -'box is to be checked onlx, if the synonyms are supplied by the user, 
n,q,C they are suggested bj^ the Inf ormaUon specialist or elicited^rom 
the user during the negotiation process. ■ ' ' ' ' ;,• 

The pWase I'logic supplied by user" should' he -^^efiked lf the uset ° 
provides the appjropriate Boolean operatbia^btJi^^eit^ ^q&i^aierlt , i.e. , the 
user has some Jcijowledge of how a search stVffe^^.S^t^d' and provides ' 
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^fe^.-^-QgJ^c J jjlk'i og key concept-s-or-k-eyverd3 7gi>T:; 



The phrase "constraints supplied by user" refers to those items 
^suggested for inclusion, exclusion, or consideration by the user, not " 
those items supp^l^ by. the information, specij^list or elicited frJL the 
user during the negotiation or searching process. Exampjgs of c||^raints 
are:', citations in the Engiisr language only (and not foreign);, personal. • 
authors (Smith,, F. Harry) r ^ypes of publications to be included .or ex% ,. 
eluded (paints, journals, books, technical reports, confereii^e proceefing^l 
•dissertations); maximum number of citations (the 20 most recent; no inore'' • 
. than 100); time period (last update code; last two yeai^ ohl## sijiii ■ > 
examples of "other restrictions" ar4: CA section numbers; sponsoring Z ' ■ 
agency; article title; journal name; review articles; and other language 
_____ res ..„.^ - . 

■ ■ ■ / .. ■ ■• ■■■'■"^ ^ ' ' ■ • ' 

^ Primary applications": check all that apply. "Teaching" in- , 

eludes searching for citations , to prepare a lecture. "Research%also 
includes dissertation .work. An example of "other" would be course rela;;ed/ V 
• applications. Under "&tl£r'^ in question 5 , one c^^^ 

related applications, are fo'r papers for seminars, classes" 
.^ ,p:%°airectdi^|^indlvid.u study", "eU^j^"' ■ . . T . '^''^t,^'''^'-- 

' "User's types of approaches and purposes for this search": . . 

' check all. that ' ^PPj^^^s jiot necessary tddBcheck one box in -each .o^f 
:\x ''^''^^S^^iS'°^ Approaches';,or^Purp(^e of Use. J' ' - 

2^^%rWP^ °^ approach^is the same 'as SDI •(selec- 
.."■' m^^^^ ■ . - • • 0 - . ■ V ^ • ■ 

, tive. dissemination of in'fbrmation). A good example of this"' type, of .approach ' 
is an update , e.^. ,.. the search statement - ALL HYDROGEN// 'anD ALlJ B0^^ 
•• . .!'^^B^>^<UP) --'to bfe executed^fon CHEMCON. Since-,, the information sp?^ ' ' ' 
""^^i^ ^^^^^^^'PV^f^^^ ^^'^i^^st^, comsider the|e as-redej.ved*> ' 

' ■■ ■ • ■ ' ■ . '-v .■'. ■ / . ... 



_bjL:oth«_Jb.ao_final_uafir.'I_Cquestlon-^^^^^ 

CO Include , time period constraint (question , 
clalist'sVfonn. The user should react to each SDI update; 
. An -'exhaustlve'VseaiJifeh Implies a comprehensive, retrospective ^appr^^ 
to a topic. In some cases the user requests,only "a few references on (al. /.y^ 
topic"; however, in many cases, the user's type of approach is t^^c^ 
through all relevant information existing ^on a toplq (e:diaustivSKt?^^'^ *^ 
he receives only a few references oA a topic instead,' Check 
next to the phrase or woij^ most closely corresponding ^w^Vu ^ 
approach, not the word or phrase which* corresponds to whdt B^^^BSi^edi 
"BrowsinB'' takes, place when the user attempts "to see \^^^S^3-^stem 



can do or what there is on a given subject in ^he data ba^^^Tmanner ' 
that is not as systematic as "exhaustive" or a ''few references on topic"; 
for example, "lanthanides " as a broad subject which is further narrWed 
on-line to "cerium." A user. looking for citations to documeiits" pertaining 
i:s3.<^^"ip?ent set-up or maintenance would be using the "specific fadts or 
>gp^^|ires" type of apflllich. ' ' . ^ ■ . ' . ' ■ 



r A search dealing with only q^e topic m^j^ be considered as '.'Keeping 

cuisrej^ on: developments..'.." eveij though ^uch a search is not Current 

''^^^^^^ <^^^^^ An example #f ':d6Velopmentsin owri^b. 

areas of competence" might be the topic' nu(^LearVm%ietic resbA^ice (NMR) * 

and nitrogen,- 15 ; whereas , an example of "develppmeilt^^n related areas 

mi^ht be the topic electron paramagnetic "resonance or ESR) and *V 

■ . ■*■ ' ' J'^^'- ■ ' ' ' ^ '■' ' ." 

nitrogen f. 15. ' Jf ^jftU '^re, in* doubt as to, •'own" or "i^elated" area of ' 

competence, afi^lc-^the user. ^ ^ ' Iv^ 

In some ceases ^ user might "brush up'' on an earlier ^ea of competence 
^uch as the toplc/sta.fristl^^^ a "new special ty J' si^ch as ^ the 
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biochemical topic active transport needed^ by an inorganic chemist. 
This is apt to occur- when a new project is started. Any topic_related 
to supporting work related to on-going projects" might be "theory" 
(diffiision)-, "facts" (boiling point of water) , or "procedures, apparatus 
or methodology" (Vah de Graaf f accelerator) . The category "patent appli- 
cation" should be interpreted broadly' to include patent disclosures as 
well. Examples of "other" include testing the system, grant proposes, 
dissertations, technical reports, px papers for seminars, course require- 
ments, or directed individual study. ^ 

6. "Sources employed -By user for searching this topic prior to ' 
seeking this on-line search": check all that apply. An example of "other" 
would be the use of print-out results from previous 'Searches , e , to 
obtain different or " additional keywords or to devise a new search' strategy . 

7. "Negotiation time": an estimated time. Include *time spent 
With SDC microfiche, vocabulary aids, and working out strategy whether or 
not user is present. Do not include time spent learning the data base 
characteristics. 

Post-Search Querstions 

8. "Files 'searched": check all that apply, e.£., more than one 
data base may be indicated.' Examples, of "other" include SSIE and NTIS; 

9. "Number of search statements": the last SDC search statement 
with postings. If you- restack rased all search statements, changed ' 
da^a bases, or in some other manner affected the SDC total number of 
search statements, please add the ihdividual search statements together 

so" that a total figure is given. ' ^ 

10. "Number of unique citations printed on-line": a hand count. ^ 
"Unique" means rfbt to count duplicate citations, e.^. , If 5 citations are ' 
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P?Anted_bT__ti^tle_on^^^ 

in a final listing of citations, count only 9 on-line citations, not 13. 
Citatfions printed on-line in abbreviated form (such as article title" or 

PRT TRIAL") do not have to be counted. Count only those cfant^ining 
- » / ' ' ' 

sufficient information to. locate the document. 

» ^ • . 

Unless fhe user will be antagonized, the practice should fee to repeat 
on-line citations in any off-line printouts. Two examples are as follows: 
1) Jones, working with th,e information specialist, viewJ three 'sep- 
arate "PRT TRIAL" ^ommands or a total of 6 records ii narrowing ' . 
his search. Ten citations are then printed on-line is ing the 
tailored print command "PRT 10, TI, AU, CP, SO, KW"; 100 citations 
(including the 10 printed on-line) are then printed /off-line. The 
nt^mber of unique citations printed on-liTne (questioJ 10) is .thus 
10; the number of citations printed off-line is 100/ (question 11); 
aniRthe total number of citations retrieved (questijbn 1, User's 
Reaction form) is also 100 (not- 110 or 116).' 
2) Fisher, working with the information specialist, vLws 20 titles 
on-line and selects 5 to be printed using the "PRT/" command; 
he wants the other 15 cations to be printed offtline but insists 
that the 5 he already has not be repeated. Fill /in 5 on-line 
citations for question 10, 15 off-line citations/ for question 11, 
and a total of 20 citations retrieved on the Us/r'a Reaction form, 
question 1 (npt 40 or 45) . • 
, 11. "Number of citations printed offlline": the iumber of postings 
printed using the ci?mmand "PRT OFFLINE ... " In many caska", the -off-line 
and on-line citations will contain duplicate document citations. These * 
/duplicates should be subtracted" before completing question 1 on the User's 
/ Reaction form (see the example under 10 above) . The. SDC. flat charge .per 
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9 . ^ 

Citation encourages the use^ of "PRT FULL OFFLINE INDENTED" rather than 
the compact form where category names are abbreviated.; Since this print 
command provides full , information 'for the end-iiser. and also helps the 
'■ ^ . information specialist by providing keywords for improving the~ search, it 

should be used whenever possible. ' 

12. "Connect time in minutes": -the number of minutes given when 
the command "TIME INTERVAL or "TIME RESET" is used. If you forget to 
record this information during\he initial search, the time given on the 
monthly SDC invoice may be used. i 

"Staff time with user": an estimated time. This time 
may include general discussion of print^out citatibng, the length of time 
it will take off-line print-outs to arrive, explanation of CP, etc. Do 
not include time.spent in general conversation, completing , the Information 
, -Specialist'-s form, or explaining^ the User's Reaction form.' ' 

14. "User present during entiije searlh": -check one category only. 
^ The user must be with the in'Tbrmation specialist --either in person or by 
telephone during the complete search from start to finish.^ If the user is 
present at the beginning of t;Jie search and leaves while citations ire 
^ begin printed, do W count the user as' "present dui^ng the entire search." 
-If a search is performed on CHEMCON with the user present and ^ater the 
search is p6rformed on CHEM7071 without 'the user being present, do not 
count the user as present. 

/l5. "Did user interaction take pllce during the search?": , check one ' 
category only. If at any tipe during the search user interact i'agj^alles - . 
place for .modification or confirmation purposes, check "yes". An example , 
of modification would be when the user sees or is told there are 1000 
postings on his topic and he requests only those for the "past year. An r 
example of 'confirmation- would be' if the u?er sees the citation results of^ 
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a " PRT TR IAL" and' agrees these are what he wants. If a use r la preaefit 
only "sits" and does- not Interact for confirmation or modification purposes* 
then check Vno". 



16. "Did technical' problems delay the on-line search?": check all 



t apply. Technical problems can be any mechanical malfunction af fee t- 
ing or delaying the search. If you are not sure what- caused the trouble, 
check "other" and specify the difficulty. Do not include problems relat- 
Ing to search strategy. Examples of technical problems are: log-on 
problem TYMSHARE, log-on problem SDC, disconnect TYMSHARE, disconnect "SDC, 
telephone problems including line noise- ' terminal malfunction, ^window change, 
"garbage" received, and host down (all ports busy, ORBIT. not active,' or 
' 'other associated messages). TYMSHARE should be used in\ broad sense and 
inc3,u^e problems associated with TELENET as well. 
User' 3 Reaction to On-Line gearch Form 

\ """^e number of citations^retrieved by this Search was 

the infcirmation 'Racialist should fill in the appropriate info^t'ipn for' 
,this question^ Only th^ total nu^er of unique citations , should be given: 
that is, if 10 citations .on "mercury" were printed on-line and .the Vame 
10 are included in' 100 cftatidns on '.' toxicology" printed/ off-line, then, the 

:i ' ■ ■ • . ■ c ■ ■ 

total numbej of citations printed ia 100. If citations are printed , both 
on-line an*^- o^f-line; or' only off-line, ;a - the User's Reaction form 
until the off-line citations arrive, then attach and forward to the user 
who will complete questions la, lb, Ic, Id;" 2, 3, 4 and 5. When the' com- 
pleted User's Reaction form is returned, attach it to the appropriate 
Information Specialist 's .Record of On-Line Use form for filing purposes. 
It. is conceivable that no citatidns will be found. The user should still 
be asked to react to thes^"no hits"^ 

Revisied October 18, 1976 
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'GUIDELINES FOR MTC'S INFORMATION SPECIALIST'S 
/ RECORj) OF ON-LINE USE . 

/ 



' The following discussion and definitions may be helpful in conq)let- 
ing the Information Specialist's Record of On-Line Use form. It is 
s.iiggested that the user information, search number, "S^^rched by," 
/"l)ate searched," and "Pre-Search" sect ion. be completed prior to the 
/ on-line search ahd that the ' "Post-Search" section be completed immediate- » 

// ly following the terminal search, while the print-out is still ava^^l- 
able. Each separate search topic requires an Information Specialist's . 
form and a User's Reaction form. If yon are liot sure it is a separate' 
search topic, ask the user. 

, Pre-Search Questions 

1. "Search request received": check all that apply. The phrase 

"in writing" refers to formal correspondence, * as well as a few kejrwords * 
jotted down on scrap papef.- The phrase "other than final user" refers to 
requests received by a third party, e i^. , John Jones (group leader) re- 
quests a search to b.e given to and used b/ Bill Smith (bench chemist) ; 

. . ». ■ 

Bill Smith will complete the User's Reaction Co On-Line Search form. 

♦ ' «. . . ■ 

2. "Relationship to previous searches": check one*l:ategory only. 

A "new^search" should be counted for each n^ topic that is not a \ 

* .\ 

"modification" or !'continuation" of any^-^rleviously conducted .search. It 

" ' . » ' ■ . / \ 

is conceivable that more than one search, will be received and conducted 

at one terminal session for more than one user. If you arg not certain 

" " * ' ' ' " - . 

that.it is a "new search" for the user present, ask the user. 

*■ 

\ ' • ^ . ' . ■ 

Examples of a "continuation/update of previous search" are: ^^-^ 

(a) the' search is performed on a different, data base, e^.£. , the search '^4 

tojiic was initially searched on CHEMCON, the user then returns and requests ' 
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•the uier tHe„ returns and xe,u„ta the s^rch be 'Wated" on 

CHEftTbn: (I.) a search la perf„r«d on CHEMCOH. ^d a.^on'th later the „a.r 
retu^a and re,uests that th. sa^ search he done for the last W eeks' 
on C^o., l.e.. SDI service' (selective disse-nation of 'inf oration, . 

A 'Vodiflcatlon of previous ..arch" occtrs .hen a new search strategy 
is Adopted, additional keywords are eiployed, or other devlces-^are used 
to thange the approach to the toflc .hlch .aa previously searched, 'if ' 

cross data bases during the si.e .ter^nal session, count as one search 
Ue one Infor:»tlo„ Specialist's for™ and one User's Eea^lon fon.) ■ 
unless a different topic' is searched. • When crosslns data -bases, a iertaln 
K.unt of vocabulary change is necessary, however, count' as a ■.continuation 
f previous search" unless based upon previous print-outs "and/or user 
interaction, the search is so improved or changed' that it ^sfbe counted . 
as a "modiflca^tion." 

■ ,3. "Initial S4^ch request": check all that apply. An •••initial 
search re,uesf refers to the search re,ue,t as it is presented to the' 
lnfor„atipn specialist by the user before any negotiation takes place. 

- The «,rd "synony." should be used in its broadest sense..^.^.. ^ " 
or nuclear ^.a^etic resonance: transition „etal. organo^tallic, or 
manganese Would be co^idered synonym . u should be e^hasLed that . ■ 
this box is to-be Checked onji if the synonym are supplied by the user, 
not if they are suggestedsfe, inf or^tlon^pecialist or elicited f ro» ■ 
fhe i^er during tke negotiation process. ' . ' 

The phrase ••logic supplied by user'^ should be checked if the user 
provides the. appropriate Boolean operators or their equivalent, i.e. , the 
user has so» knowledge of how a search strategy is formulated and provides 
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..... _ „ ... _ . ... . . ^. 

the logic for linking key concepts or kesrapj-ds, 



The phrase "constraints supplied by user" refers to those Items ' 
suggested for inclusion, exclusion', or consideration by the user, not 
thpse items ^supplied by the information specialist or elicited from the 
user during the negotiation- or searching process. Examples of constraints 
: clt^jfdns^ in the fenglish language only (and not foreign); personal 



are 



itatto 

^^yJV - - 

■authors ^jSmith, F. Harry); types of publications to be Included or 
excluded (patents , j oumals , book3 , technical reports , conference 
p?:oceedings , dissertations); maximum number of citations (the 20 most 
re^^ent; no more than 100) ; . time* period (last update code; last two years 
only). Some examples of "other restrictions", are: CA section tiumbers; 
spotisoring agency; arcicle title; Journal na^^T^eview articles; and other 

■ • [ H • ' 

language restrictions (English and French) . 

4. "User's types of approaches and -purposes for this search": check- 
all that apply; it is' not necessary to check one box in each of the broader 
categories "Types ^f Approaches" or "Purpose of Use." 

A "current awareness" type of approach is the same as SDI (selective ** 
dissenfiknation of information). A good example of this type of approach ' 
is an update, e.^. , the search statement — ALL HYDROGEN// AND ALL BOND: 
AND 7615 (UP) — to be executed on CHEMCON. Since the information spe- 
cialist initiates permanent SDI requests, consider these as received 
"by other than final user" (question 1) . For each SDI' request be sure 
to include time period constraint i^iuestion 3) on each Information Spe- 
cialist 's form. The user should react to each SDI_update. - 

An "exhaustive" search implies a comprehensive, rettospective approach 
to a topic. In some cases the user requests only "a few^ references on [a] 
topic"; however, in many cases, the user's type of approach is to check 
through all relevant information existing on a topic (exhaustive) but he ^ 



recel4^ a few references on a topic Inste ad. Check t he box next to 
the phrase'^^d aost closely corresponding to" the user's approach, not 
the word -or phr^whlch corresponds to what the" user received. 

"Browing" takes place Wh6n the user attempts to see wh^t' the system- 
can do or what there Is on a given subject In the data base in a mamxer 
^ » that Is not as systen^tlc as "exhaustive" or a "few re^prences on topic"; 
. for example, "lanthanldes" as a broad subject which Is further narrowed 
■j^ . on-llpe to -Icerlum. " A user .looking for, ^tatlons to documents pertaining 
^ ^ to equipment set-up or malnteS^ce wpuld be using the "specific f alts or 

procedures" type of approach. • 

A serarch dealing with only one topic may be considered as; "Keeping. ' " 
current on: developments. ... " even ^ though such a search Is not "current 
/awareness" on an SDI type basis. An example of "developments In own areas 

,of competence" might be the tojMc nuclear magnetic resonance (NMR) and - 
•♦.nitrogen - 15; whereas an example Qf "develo^nts In rliatte^ areas" might 
be the topic electron parama^etlc resonance (EPR oiTesR) and nitrogen -15. 

If you are In doubt as' to "own" or "relateH" ar-o=. 

kD related area of Competence, ask the 

user. ■ ^ . . \ , 

, . . In 9ome cases a user might "brush up" on an earlier area of competehde 
such as the topic statistics, or learn a "new specialty" such as the bio- ■ 
cb^lcal topic active transport needed by an Inorganic chemist. This Is 
apt to occur when a new project Is started. Any topic related to "support- 
ing work' related to on-going' projects"" fnight be "theory" (diffusion); 
"facts" (boiling point of water), or "procedures apparatus or methodology" 
(Van de Graaff accelerator). The category "patent application" should be 
interpreted broadly to Include patent disclosures -as well. Examples of 
"other" Include testing- the system, grant proposals, dissertations, tech- " 
nlcal reports, or papers for seminars, course requirements, or directed ' 
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individual study. * 

5. "Sources employed by user for searching this topic prior to 
seeking this 'on-line search": check ^ that apply, /^ewample of "other 
would be 'the use of print^out results^ from previous searches, e.^. , to 
obtain different or additional keywords or to devise a new search strategy 

Post-Search Questions 

3 ■ 

6. "Files searched": check all that apply, e.£., more than one data 
base may be indicated. Examples of "other" include SS IE and NTIS. 

7. "Number of'^search statements": the last SDC search statement 
,wlth postings. If you restacked, erased all search statements, changed/"* 

data bases, or in some other manner affected the SDC total .number- of . / ' 
search statements, please add the individual search statements toge>ther 
so that a total figure is given. 

8. "Number of unique citations printed on-line": a hand count. 
"Unique" means not to count duplicate citations, e , if 5 citations are 
printed by title only and then these same 5 are printed along with 4 others 
in a final listing of citations, count only 9 on-line citations,' not 13. 
Citations printed on-line in abbreviated form (such as article title or 
"PRT TRIAL") do not have to be counted. Cqunt only those containing" 
sufficient information to locate the document., ' . 

Unless the uiser will be antagonized, the practice should be to repeat 
on-line citations in any off-line printouts. Two examples are as follows: 
1) Jones, working with the information specialist, views three 

separate "PRT TRIAL" commands or a total of 6 records in narrowing 
his search. Ten citations are thenprinted on-line using the 
tailored print command "PRT 10 tl, AU, CP, SO,'KW"; 100 citations 
(including the 10 printed on-line) are then printed off-line. 
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' nunber of unique citatiops printed on-line (quescion 8) is 

thus IQi the number of citations printed off-line Is lOO 
. • (question 9); and the total number of stations retrieved (queatloj?. 
1, User's Reaction form) Is also 100 (uot 110 or li^") . 

lalist, views 20 titles 
the "PRT- cOTtaand; he 

wants the other 15 citations to be printed off-line .but insists 
that the 5 he already has not be repeated. Fill m 5 on-line 
\. citations for question 8, 15 off-lfne citations^or question^,'. " 
and a total of 20 citations retrieved on the Uset's Reaction form, 
que^tftion 1 (not 40 or 45). ' - 

9. ■:'Number of citations printed, of f-iiile": the number of Postings 
printed using the coimiand ''PRT OFFXINE. . . " In many cases, the off-line 
and on-line citations will contain duplicate document citations. These 
, duplicates should' be subtracted before completing question 1 on the- User's 
Reactioij form' (see the example under 8 above)% The SDC flat charge per 
citation encourages j^he iise o'f^"P.RT FULL OFFLINE INDENTED" rather than the 
x:ompact form where category ^names are abbreviated. . Since this prtnt 
command provides full information for the end-user, and also heXPS the 
information specialist by providing keywords for improving the search, 
it should be used whenever' possible. ' , 

10. "Connect time irr minutes": the nifmber of minutes given when the " 
command "TIME INTERVAL" or "TIME RESET" is -used. If you forget Co record 

this information during the initialsearchr, the time given on the monthly : 

SDC invoice majr be used. -^BP' - * i 

11. "User present during entire .ch": check one category only. 
The user must be with the infonnatio' xialist either in person or by 
telephone during the comr; I /te .search irom start to finish, if the user 
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^i"s Pre(3enf"at"tre"l)-eginS^ " 
are being printed . do not count ^he user as "present during the entire 
,^earch." If a search is performed on CHEMCON with the user present and 
later the search is performed on CHEM7071 without the user being present, 
do sot count the user as present. Y ' / 

12. "Did user interaction tal^ place durlAg the search?"": cheekbone 
cate^o^ only. If at any time during the search user interaction takes 
, 'place for modification or confirmation purposes, check "yes". An example 
. ^ of a modif icatipn would be when the user sees or is told there are 1000 
postings on his topic and he requests only those for the past year. An 
exaniple of confirmation would belf the user sees the citatign results of 
a 'TRT TRIAL" and agrees the^e are what he wants. If a user is present 
but only "sits" and does not interact for confirmation or modification 
-purposes, theh check "no". • 

13.. "Did technical problems delay the on-line search?": check all 
that apply. Technical problems can be any mechanical malfunction af- 
fecting or delaying the search. If you are not^sure what caused the 

trouble, check "other" and specify the difficulty. Do not include problems - 

... * . . . - " ■ 

relating to search strategy. Examples of technical problems are:, log-on 

problem TYMSHARE, ,log-on problem SDC, disconnect TYMSHARE, disconnect SDC, 

telephone problems including' line noise, terminal malfunction, window change, 

"garbage*; received,' and host down (all ports busy, ORBIT not active, or " 

Other associated messages). TYMSHARE should be used in a broad «fense and " 

include* problems associated with TELENET as well. " . 

» • ' • 

User's Re action to On-Llne Search Form 

1. "The number of citations itjfetrieved by this search was _ 
^ _ — • — ^ 

the information specialist should fill in the appropriate information . 
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f ay th is iiues tlon. Only the tot al . nu mber^ of unique cltatiar,^ ^hmild bft 



given; that is. If 10 citations on "mercury" were pjrlnted on-line and the 
same 10 are included in 100 citations on "toxicology" printed off-line, 
then the total number of citations printed is 100. -If citations are printed 
bdth on-line and, of f-line'.^STonly off-line, save the User's Reaction form 
until the of f-line citations arrive, then attach and forward to the user 
who^l complete questions la, lb, Ic, Id, 2,. 3, 4 and 5. When the com- , • 
pleted User's Reaction form is returned, attach it to the appropriate 
information; Specialist's Record of On-Line Use form for filing purposes. ' 
It Is conceivable that no citations will be found. The user should still 
be asked to react to" these "no 'hits". v 



J 



Revised. October 18, 1976 
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USER DEMOGRAPHIC DATA\/ 



During pro^JiBc^ .phases II and III, demographic data on new users to 
the serviceVvfere' 'obtained by Interviewing each user during his or her , 
first visit. The,, interview questions were intended to provide primary 
information for later analysis and the responses were noted on a 
c5rd file. 

The interview questions consisted of the following: 

Name . . ♦ ♦ - . . , 

Status (fgAlty, research associate, graduate, etc.) 
Sex 

Highest educational level (BA, MA, etc.) 
Year in which highest degree was obtained 
Major field of highest degree 

Len^h ofr^time at FSU ' ^ 

Present. position at FSU , ^ 

Name of major professor (for graduate Wudents) 
If ever previously used an onliiU search system 
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.OtxrCike Search Pr^oject 

Monthly; Searches 
By Type of User 
FSU Chemists 



TYPE OF USER ' 

f 


V ^BER OF 
• * ^IQUE USERS 


• 

NUMBER OF ' 
SEARCHES 


'New 
User& 


Previous 
Users 


; Total 
Unloue 

USCTS 


Searches 
for 
^ew n^eT<? 


Searches 
for 

, Users 


\ Total 
Searches 
for All 
Users 


Faculty Members ; 






— i# 




1 




Research Assoc./ 
Post Doctoral 
Fellows 














Doctoral Students 














Total All 

Sample Users ^ 














Non-Sample Users 














Total Pp.1 Vserl 
















Total Number of .Working Days 



Average Number ot All Unique Users/lVorking. Day 

/ * 

I Average Number of All Searches/Working Day 
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SEARCHING CHEMICAL LITERATURE BY COMPUTER 



How You Can Get More From Your Computer-aided Search 

. Whatever siibject you want to find through the computer search atftvlce, you 
can get more Information and get It faster If you can describe the termp 
yoti want and how they are linked together. Here's how to do. this. 

TERMS 

If possible before you come to the Search Service office, write out the names 
of the compounds, chemicals, reactions, processes, author names or other subjects/ 
you are looking for. This will make. It easier to explain your search to the 
• information' specialist. Be sure to include any other words thkt hav6 the same / 
meaning as the specific one you want, plus any abbreviations : or chemical 
symbols (but not formulas). j . /' 

For example, a search for Iron compounds should i.nclude the terms "Iron" an^' 
Fe and possibly "Ferrous." The more terms you the wider the scope/of 

the search. To help you, the Information specialist has lists of terms that 
are Used f orr;lndexlng , and can also check for possible misspelled lndex*,terms 
that might have been used., / 

t ■ ' 

SEARCH LOGIC , 

Try to put together the terms in the logical way you want them combined. For 
example. If you vanC all the references on "reactions involving sddium and 
chlorine, ask yourself if you want reactions involving sodium along with 
chlorine, or reactions with dbdium dnd, in addition but separat^lT Triictions 
with chlorine. "y 

' ' . -. : 

The logic used by the computet ; system is called Boolean logic. This uses the 
logical connectors AND, OR and ,. AND NOT. They are Illustrated by the following: 



AANDB .^ "^AORB . A AND NOT B 

(The shaded portion^shows which citations will be retrieved by the computer.) 

The connector AND says that both terms A and B must be used to index the citation 
^before it will print out. AND is the restrictive 6r limiting connector. In the 
example above, the search would be written as: REACTION AND SODIUM AND CHLORINE. 
All three terms must be in the citation for it ^to print out. This search gives 
all citations that involve both chemicals. 

y ^"tZ^^^^^ ^'^''^ chemical separately,, two search statements would be used: 
REACTION AND SODIUM; REACTION AND C«rLORINE. 

The OR connector gives the broadest scope and picks up any citation that 
Includes Term A or Term B. For example, REACTION AND. SODIUM OR REACTION AND 
CHLORINE will pick up all citations that have either Chemical. ^ 
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In sdme birches, there will be overlapping terms, wlthlonly one aspect 
that distinguishes the citations you want from those yoi don't. In these 
cases, the logic can be Term A AND NOT Term B. If^ri were two possible 
reactions with the two, chemicals, you could specify Readtlon (type 1) AND 
Sodium AND NOT Reactlon^^^tjqie 2). 




LIMl|fclG SEARCHES 



Jfjr.f* search will find many cltatldns, you may want to 

limit the number by restricting yo&r search' in one of se^teral ways. You may 
search only from a certain year to the present, e.g., "slEce 1975." Or you 
may w^t «» f ind oniy review articles. Or you may want, okly those references . 
in the English language. Just tell the information speciklist what limits 
^^otryant. • . , ~ j-«.«m.^o 

aijthor\searcbing ■ 



You can also search for citations by specific authors, id is helpful if you 
can write down the exact spelling of the author's first naae (or Initials) and 
last name, and in<^ckte any different ways you have seen t lat author cited. 
For example, Jaaes^.^. Smith may be cited as: SMITH J. SMI^H JAMES A. SMITH J.A 



OTHER DATABASES" 



;.In additio^n to -chemical databases ^we can also search ones that cover related 
■i fields including biology, (and blodhendstry) , engineering (aid chemical 
engineering) and geology. X ~ 



>Prepared by the Online Search Service Research Project, Chemistry Bldg. Rm. 105. 
Oc^er 1977 ' 
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/JlQ53Liri sdcfsu33 * • 

YOJ T^RE ON LINE 1.99 . ^ 

^ HELLO FROrt SHC/ORBir. (11/28/7.7.. 8M8 A.M. PACIFIC TIME) 
you. ARE NOW CONNECTED TO THE ORBlT DATABASE. , 

ENTER SECURITY CODE: * 

PRoor 

ARE YOU A NEU USER? IF YES ENTER Y. -JF NO ENTER N OR A COMMAND,./ 

. user: . • ' 

"file chemcon" 3-. 

prog: 

elapsed time on orbit; 0.01 hrs. 

you are now connected to the chemcon database. 

ACS COPYRIGHT. c \ - - « 

prog: • ! - 

S3 1 /c? 
^ user: • 

N-anthine and all dehydroaenaset or all jcanthinedehyc^roaenase* or jc'dh 

prog: , • " ^ 

SS 1 PSTG (103) . / 

■ r 

SS 2 /C? 

user: 

1 and not all fisher j: (a'u) 

prog: • 

SS 2 PSTG (93) 



SS 3 /C? 

user: 

2 and liver or 2 and all hepat: 
PROG : . 

3S 3 PSTG' (35) 
SS 4 /C"? 

user: 

3 and not. ret 



PROG : , 
SS 4 PSTG (31) 



SS I, /C^ 

usek: / 

4 dnd f roin 75 thru 77 3 0,3 



PROG J 

SS 5 fSTG (IS) 
SS .6 /C? 

user; - 

full ■ 

. prog: 



- CA0S7151138><iE 



-1- 
An 

TI 



AU 

OS 
LO 

so 

JC - BIJOAK. ^ . i 

PY - 77 , ■■■■■■■ ■ ! - ■ 

DT - J ^ i 

LA - ENG - i ' 

CC -,CA007013 1 

IT -'xanthine DEHYtlROGEN(!^SE LJVERI REDOX POTENTr^L 



OXIDATION-REDUCTION POTENTIALS OF TURKEY LIVER XANTHINE 
DEHYDROGENASE AND THE ORIGINS OF OXIDASE AND DEHYDROGENASE ' 
BEHAVIOR IN MOLYBDENUM-CONTAINING HYDROX'l^dSEa 

- BARBERf MICHAEL J..; BRAYr ROBERT C? CAMMACK. RICHARD; CGUGHLAI 
MICHAEL P. j 

- sch;: MOL. sci. f univ. susse)^» Brighton 

- ENGL. ! W ■ ' 

- BIOCHEM. J. 163 2 279-89 1 



SS 6 /C? 

user: 

•stop" 

prog:' 

DONE? (Y/N) 
USER : 



FHQOl . i ^• 

TERMINAL session FINISHED 11/28/77/ ^8:24 A.M. (PACIFIC TIME) 
ELAPSED TIME ON CHEMCON; 0.11 HRS. ' 
TOTAL ELAPSED TIME: 0,11 HRS. ,J - 

■ ■■ ".uJ^S 

PLEASE HANG' UP YOUR TELEPHONE ;>«^<i^^^^^ ! 
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School of Library Science ( The Florida State University 
. * ' / Tallahassee, Florida 32306 




^5 I £ 1 A N.D U M 

■• ^ - ^- ' / - ■ ■ 

TO: Participants in On-JLine Search Project ' 

FROM: Gerx^ahoda and Al Bayer 

SUBJECT: On-Line Searches ' \ 

Beginning Friday, May '28, 1976 we will be offering free on-line search 
. services to you in Chemistry Research Building Room 105.' 'Marcia >fyers and 
Sharon Selman will do searches for you during the following fiours for the 
remainder of quarter III: ^ j. . . a . . > \ ^ 



W(ppdays thrii Fridays 9:00a.m. - 1:00p.m. 

Monday and Thursday evenings 6:00p.m; - 9:00p.m. 

Tuesday ancj Wednesday afternoons 1:00p.m. - 3:00p.m. 

. v . " 
, Based upo^ .lirser' needs, new, mutually agreeable, hourd can be arranged 
for the summer. To have searches made either , stop by Room 105 or give 
flarcia pr Sharon a call at 644-5033. - ' ' 

Although some may iiot be appropriate to your information needs, the 
following System Development Corporation data bases will be available to you: 

y-' .*. ^ , * • " - 

CHEMCON ^nd CHEM7071 . . Topics cotrered are those found in Chemical Abstracts 
Condensates, prepared by Cl^mlcal Abstracts Service. CHEMCON includes materials 
from 1972 ta ifte; CHEM707]Ncovers 1970 to 1971., CHEMCON has over 1.3 million 
records; ^^^9^71 has over 580,000 records. About' 12,000 records are added 

to ^^^^^P^^'J^y* " 

CAIN, Cataloging and Indexing data base, prepared by National Agricultural 
Library. Covers world-wide Journal and monographic literature in agriculture 
and related subject fields, including general agricultural and rural sociology; 
economldrs; consiimer protection and human nutrition j animal science; veterinary 
medicine; forestry and plant-related areas; chemistry; natural resources, ento- 
mology; and agricultural engineering. Includes materials from 197p to date — 
over 692,000 Items. About 12,000 records added mojithly. 



CIS INDEX . Prepared by Congressional Information Service. Covers U^S. * 
Congress publications: hearings; cUmnlttee prints; House and Setiate Reports., 
Documents, and special publications ; ' Senate Executive Reports and documents . 
Subject coverage is multi-disciplinar>r and ^topical* Includes materials' from 
-^1970 to date — over Sa, 000 items. Abolit 900 records added monthly. 

30o 
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COMPENDEX > Prepared by Engineering Index. Corresponds to Engineering 
Index Monthly . Covers civll-envlronmental-geolqgical engineering; "mining- 
metals-petroleum-fuel engineering; mechanlcal-automotlve-nucXear-aerospace 
eirglneering; electrical-electronics-control engineering; chemical agriculitural- 
fopd engineering; and industrial engineering, management, mathematics, physicis, 
and instruments. Includes material frqm 1970 to date— over 425,000 items. 
'About 6,000 records added monthly. 

ERIC. Prepared by the National Institute of Education. Covers, report 
and periodical literature in many education and education-related areas: 
ed^icational management; higher education; information resources; science; 
mathematics and environmental education; teacher' education; tests, measure- 
ment, and evaluation, and others. Includes material from 1966 to date—oye?: 
220,000 items. About 2,500 records added monthly. . ^ 

' GEO RE F . Geological References file, prepared by the American Geological 
Institute. Covers geosciendifcs literature from 3,000 jtburnals , plus conferences 
and major symposia and monograplt^, in such'' areas as engineering-bnvironment 
geology, geochemistry; geomorphology, hydrogeology, igneous and metamorphic 
petrology, mineralogy, ocfe^nography ,' paleobotany, sedimentary petrology, soils, 
stratijftraphy , and structural -geology. Includes materials from 1967 to date — 
overy^ro3,000 items. About 3,000 records added monthly. 



LIBCON/E and LIBCQN/g and LIBCON/S. Prepared by Infprmation Dynamics 
Corporation. Covers all subject areas In monographic ;^|.iterature and audio- 
visual materials, and includes MARC records from the-Lit>rary of Congress as 
, well as many more LC-cataloged 'items. Three different data t>ases are 
available. LIBCON/E, for English language m,^6erials ; LIBCOI^F, for noh^English 
language materials; and LIBCON/S, for current<?materlals, Includes materials 
from ^965 to date, but many publications pre-date the 20th Century—oyer 
1 roillidn records. About 7,000 records added weekly. \ 

■ ; ■ . ' 

INFORM . Prepared by ABI, a division of Data]fcourieEj," Inc^ Coversj^ 
busiiiess management 'periodical literature from over 300 Journals, in the - 
areas of finance, mianagement, economics, statistics, business lav, ^^nd 
marketing. Journals such as Duns Review > .Harvard Business Review , and * 
Nations- Business are abstracted. Includes materials from 1971 — over 
32,000 items, libout 1,200 records .added monthly. 

NTIS . Prepared by National Technical Information Service (NTIS) of the 
U. S. Department of Commerce. Is a broad and (|ross-disciplinary f lie 'coiftaining 
citations and abstracts of government-sponsored R&D reports and othet government 
analyses prepared by Federal agencies or their contractors and grantees. 
Corresponds to the Weekly Government Abstracts and the seirfL-monthly Government - 
Reports Announcements . Includes materials from 1970 — over 314,000 items. About 
2,300 records added biweekly. 



P/E NEWS , Prepared by Central Abstracting Indexing Service of the 
American Petroleum Institute, Covers flve% major publications In tKfe petroleum 
and energy fields: Platts Ollgram Nevs Service , Middle East Economics Survey , 
Petroleum Intelllgency Weekly , Petroleum Ecipnomlst , and Oil Dally , Includes 
materials from 1975 to date— over 23,000 Items. About 500 records added weekly. 

POLLUTION ^ Prepared by Pollution Abstracts, a division of Data Courier, Inc 
and correfeponds In coverage to .the printed POLLUTION ABSTRACTS publication. 
Covers foreign and domestic reports, journals, contrAts and pStents, symposia, 
and government documents in the areas of pollution control and research: water, 
marine, land, and( thermal pollution; pesticides; sewage and waste treatments; 
and i^al developments. Includes materials from 1970 to date— over 37,700 Items. 
About' ij, 000 records added bimonthly. 

^ • ■ . 

SSIE .. Prepared Ky the Smithsonian Science Information Exchange. Covers 
on-going and recently Completed research In the life, ph:^tMl and social 
science^-- both basic and applied research projects.* Res ^fe ii in progress is 
Included from over 1,300 funding organizations , such as^^Kral, state, and 
local government; non-p?:oflt associations; colleges and wjlersities ; non- 
affiliated investigators; and some foreign organizations and f>rlvate Industry. 
Includes materials from Fiscal Year 1974 to date — over 130,000 items. About 
9,000 research projects and continuations added monthly. 

^^^^^'"''--^^^ 

We plan to start service with a teleprinter (T33), pending arrival ^the 
faster (30 characters /second) non- Impact NCR printer. You are invited to iRop 
by Room 105 ^ whether or not you want a search conducted. > 



^1 
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Monsanto 



»»»OM iM«Mr ft LOCATION 



«f » I :»i mil 



TO 



Paul W, Gam - Pfensacola ^ ' " 



January 20, 1976 * . . 

Computerized Searching Technical Literature - FREE 



The Technical Library - Pensacola has completed arrangements which, 
1976, gives you free on-line searching of the SDC computerized data 
This means that a large segment of the world's technical literature 
literally at your finger tips. 



bases, 
is 



Here is a unique opporfu^ity for you to: 

1* Back-up or. strengthen your project work with literature 
searches designed to your specif ic requirements. 

2. Evaluate the usefulness of these data bases and the 

computerized approach to searching technical literature. 



j- 



The scientific and patent; literature data^.bases available include: 

Chemical Abstracts ^ . * 

Engineering Index' 

Government sponsored R6eD from National Techttlcal Information 
Service ■ 

Pollution and Environment, based on Pollution Abstracts ^ 
Derwent -.World Patent Abstracts tj^ 

*There are 10 or more non-scientific data\bases i^luding ones covering 
marketing information which are also availabj^-*^ , . 

The reason for the free use of these computerized files is that we are 
participating in a National Science foundation sponsored study. This 
study, which is directed by the Florida State University -'School of 
Library Science, is designed to obtain an understanding of the effect of 
the availability of on-lirfe search bibliographic data bases (OLBD) on its 
intended users information style. The experience gained during .the study 
and the results of the study w^ll be valuable to all of us. ■ 

In order to participate, you will need to complete the attached questionnaire^ 
(for bacjcground information) and return it to me for forwarding to my FSU 
contact. The precise search subjects, resulting hits and names of partici- 
pating individuals are confidential to Monsanto. Your name is coded for 
this purpose (see Monsanto survey code number on the 1st. page, of question- 
naire), I will act as the MTC co-ordinator for the study. 



ERIC 



^Complete list attached. 



5erjj^* of searches covered by this sTtudy is limited by available 

,* but'' should be sufficient to handle the bulk of our needs. 



Th^ 

pinsgram mo^ 

Costs beyond this will be handled as re']gular library search requests and 
charged to your cost- center. You are requested to participate in the 
program and, hopefully, will"make multiple or reasonably 'extensive use of 
this o^rapiiterized approach to literature searching during this yjear, 
<Please^se the search request form, copy attached, when requestiing a search). 



If you do not care to participate in the NSF study, I would appreciate your 
completing the form and adding a notation "not interested in NSF study". 
You can always change your mind at a later date. Note: Most searches cost 
^15-50 depending upon the complexity of the search and the number of citations 
printed. You can avoid this cost for 1976 by participating in the study. 

Call me at ext. 7500 (Pensacola) if there are questions. 




Paul W. Gann 
Technical Library 



Pensacola 



PWGrcb 



P.S, Do not concern yourself with the mechanics of the search, 
Messrs Gann and Reynard will handle this^although we ^ 
encourage your presence during the on- liflff^ search. If 
you are so inclined, you can learn these mechanics iir 
relatively short order and handle the searches yoursellf. 
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Data 



i. 



DATA BASE 



♦APILIT' 
♦API PAT 
*ASI 
CAIN 
CHEMCON 
CHEM7071 
*CIS 

COMPENDEX 
ERIC 
*GEO-REF 
*IDC/LIBCON 

INFORM 
♦MATRIX 
NTIS 
*P/E NEWS 
♦POLLUTION 
*SCISEARCH® 
♦SEARCH 
*SSIE . 



SUBJECT MATTER AND SOURCE 



Petroleum literature,^ from 
American Petroleum Institute 

Petroleum patents, from 
American Petroleum Institute . 

Government statistical .publications, based 
on American Statistics Index 

Agriculture and related- areas, 
from National Agricultural Library 

Chemistry, from Chiemieal 
Abstracts Service 

Chemistry, from Chemical 
Abstracts Service 

Publications of the U.S. Congress, based, 
on the Congressional Information Service 
Index \ ^ 

Engineering, from 
Engineering Index 

Education, from National 
Institute of Education 

Geosciences, from American " 
Geological Institute 

Library of Congress cataloging, 
froni Information Dynamics Corp. 

Business Management, from \ 

ABI Inc. ^. ^. 

CommuW^atijipfn^^tcology, and 
Urban^;Wanning, jfrom ORBA Information Ltd. 

Government-sponsored R&D reports, from 
National Technical Information- Service 

Business news in petroleum and energy, 
from American Petroleum Institute . 



Pollution and environment, based on 
Pollution Abstracts 

Life sciences, from Institute for 
Scientific Information 

Chemical marketing information, from 
International Business Data, Inc. 

Research in progress, from Smithsonian 
Science Information Exchange 



ENTRY- 
YEAR 
COVERAGE 
. FROMI 

\JAN 1964 



♦Available excluHvelu through SDC Search Service 
Footnotes: 
1 



4 



JAN 1970 
JAN 1966 
JAN 1967 
> JAN 1965 
.AUG 1971 
MAY 1973 
JAN 1970 
JAN 1975 
JAN 1970 
APR 1972 
JUL 1972 



FISCAL YR 
1974 



NO: OF 
CITATIONS 
THRU 

169.000 



JAN \m 

\ 


fls-ooo 


\ 

JAn\i974 

V. 


I 20,000 


JAN 1970 


605,000 


JAN 1972 


988,000 


JAN 1970 \\ 


600,000 


JAN 1970 


55,000 



Dates represent years in which materials 
were entered into the files by th# data 
base suppliers. Actual p\iblicatlon-year 
coverage is/requently broader. 
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FROM: - 



COJ;fPUTERIZ£D LITERATUEiE SEiUiCH 



4 

Date 



Subject^ 



Search No. 



Charge 



File 



Description:, 



Teirms: 
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^ MEMORANDUM 

DATE: October 10, 1977 " . 

TO: Chemist^Uepartment Faculty and Graduate? Students - ■ 

FROM: Al Bajfer, Dept* of Sociology, and Gery J^hod^^^chool of Library Science 

RE: Resumptlon'^of On-Line Search Service ^ ^> 

We are pleased to announce, that the comptiter search service of 
cheznlstry-related data bases v^lll again •^be available In the Chemistry 
Department during the coming academic yiear. The search service will 
reojpen on Wednesday, October 12. > . ' ^ . 

This service allows you to rapidly search Chemical Abstracts and 
similar Indexes to locate citations on topics you are Interested In 
for your teaching, research or studies. The benefits are many. You 
can: 

* save many hours of manual searching through Indexes 

* have bibliographies produced that are tailored to your needs ' 

* Interact with the computer system to refine your Inquiry 

* discover what work has been previously done on a topic, or 

locate topics abotit which little has been written v 

* keep aware of the latest writings In your field. ^ 

The Information specialists during the coining year will be Jan 
Fennell, Bonnie JackAon aiid Bill N.eedham. Service hours will be: 



Monday 


- 9:30 - 


3:00 


Tuesday 


- 9:30 - 


3:00 


Wednesday 


- 9:30 - 


3:00 


Thursday 


- 9:30 - 


12:30 


Friday 


- 9:30 - 


3:00 



* Those of you already familiar with this service are aware that ^ 
this- is part of a , National Science Foundation-sponsored grant to study 
how and with what effect on-line search services are used. The service 
this year Will also be supported In part by the Chemistry Department 
through charges to research grants. An advisory committee of department 
faculty has been established to assist Ij^he planning and evaluation 
of the search service. The committee w^H|also consider the feasibility 
of offering on-line search services throi^Hthe Chemistry Department 
when NSF funds expire. 



New data bases have become available during the summer^ and Improved 
System design should make your searches more effective. Over 50 data 
bases are available but the ones of most Interest to you are described 
in the attachment to this;, memo. , 

For those of you who are hot familiar with the service, on-line ] 
bibliographic searching is. one of the rapidly expanding methods of 
dbing literature searching. The procedure is simple. Come to Room 
105, Chemistry Research Building (next to the elevators) with your re- ^ 
quest. An information specialist will discuss your request with you 
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to clarify your termst suggest synonyms, and" fihiiriSays o/^"Iocanrng~aI"l 
the material you want • You are encouraged to remain while the search 
is being made so that you can .interact with the responses from the data 
base to make, the results more precise. If you do not wish to remain, 
you may leave your request with the specialist and the results will be 
placed in your mailbox . ^ 
J? - , ■ ' 

the typical search takes about 15 minutes. You may obtain the 
citations immediately if they are not too numerous. If there are many 
citations (more than about 20), it is less costly if we can request 
that they be printed off-line and mailed to us. This usually takes 
only 3 to 5 days. There is no limit to the number of citations that 
may be printed off-line. 

Because this service is part of an experimental study, you will 
be given a short reaction form and asked to comment on the usefulness 
of the service. Your feedback will help us provide better service and 
will give us data/ for our research. 

We look forward to seeing you and providing this service to help 
you in your research and studies. ^ 

AB/GJ/jw 
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SELECTED DATA BASES AVAILABLE 



FOR ON-LINE SEARCHING 



CHEMCON and CHEM7071 : These are the two basic data bases which cover 
literature found in Chemical Abstracts * Coverage is from 
12,000 Journals, patents from 26 countries, new books, con- 
ference proceedings, and government research reports. -The 
data bases contain the citations only, not the abstracts. 
CHPMCON includes over 1.5 million citations from 19/2 to the ^ 
present aiflKs current within about two weeks. About 12,000 
new records are added to the file every two weeks. CHEM7P71 
has about 600,000 records and covers the years 1970 and 1971, 
with a few ^ntries^ that .date back to 1969. (Unfortunately, 
there are no files yet that go back to earlier years.) 

BIOSIS PREVIEWS ; This data base is the authoritative secondary source 
for the entire life sciences, with. citations from about 8,000 
Journals. The total number of entries is abdut one million, 
from 1972 to date. ^ ^ 



COMPENDEX ; This is an erffeineering-orlented data base^repared by 
Engineering Index and corresponding to Engineering Index 
Monthly . Topics include all aspects of eiiglneering ; chemi-* 
cal, civil, environmental, geological, meVals^ petroleum, 
' nuclear, electrical and others. Entries are from 1970 to 
date, with a total file of over half a. million citations. , 



GEOREF; This is the file of geology and earth sciences , and covers 

literature from .3,000 Journals, plus conference proceedings, 
monographs, and major symposia. Topics include geology, 
geochemistry, mineralogy, paleobotany, soils, and ^oceanography. 
Coverage is from 1967 to date, with about 3,000 records added , 
monthly. \ - ' 

SSIE; These data, prepared by the Smithsonian Science Information Ex- 
change, covers on-going and recently completed research in ^ 
the life, physical and social sciences, both basic and 
applied. Research in progrea| is Included from over 1,300 
funding agencies; colleges arw^ universities , government, 

* non-^prof it associations , and others. The file has material 

from mid-1974 and about 9.000 research projects and contin- 
uations are added monthly. 

GRANTS ; Ttils file Is a complete source of references to more than • 
1,500 grant programs offered by Federal, state and local 
. ,- governments , commercial organizations, and associations, and 
private foundations, Tt covers 88 disciplines, including 
the sciences. - 
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ANALYSIS OF USAGE GRAPHS 
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4 ' 

A study of the pattern of searches at the two test sites does not 
•suggest predictability of usage except for the ear ly^ stages of service. 
At both FSU and Monsanto, and at FSu for phia^^j^ I and II, the early 
months of service show the following pattern: 

** An "initial interest surge," with a very high number of searches 
in the first month, caused in part by curiosity of potential 
users. 

** A marked define in use in the following one or two months, 
presumably as curiosity is satisfied and immediate search 
needs are fulfilled. ' , 

** An increase in search requests but to a much lower level 
than in the first month or two. 

■ Beyond the initial three to four months of service,, -the usage 
pattern is influenced by factors inherent in each test. site, such as 
academic calendar (quarter breaks), examination periods, vacation 
times, start-up or completion of major projects, etc. 

A close look at usage was made with a chart of five-day weighted 
average of number of searches per day for the entire project period. 
Relating number of searches to various critical events ~ notably the 
in'troduction of new equipment and special efforts at publicity of €ke 
service — • showed no positive relationship between these events and 
Increased usage. 
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PHASE I (Avg.» 1.54 for sample users only; P^ASE II (Avg-LD PHASE III (Avg-rs) . 

2.4 for all users.) ^ j^ 
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ONLINE S^AR^ES - MOIViSANtp . 

based on returned feedback forms; includes sample and* non-sample 
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